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ABSTRACT 


This dissertation investigates Multidimensional Packing Problems (MD-PPs): the 
Pallet Loading Problem (PLP), the Multidimensional Knapsack Problem (MD-KP), and 
the Multidimensional Bin Packing Problem (MD-BPP). In these problems, there is a set 
of items, with rectangular dimensions, and a set of large containers, or bins, also with 
rectangular dimensions. Items cannot overlap (share the same region in space), and, 
when packed, must be completely located within the bin. We develop new theory for 
PLP, and apply it to the construction of new bounds, heuristics, and an exact algorithm. 
The bounds verify that the heuristics optimally solve 99.999% of PLP instances with up 
to 100 items; in the instances that the heuristics fail to solve optimally, their best solution 
differs from the optimum by only one item. Using our new PLP theory, we implement 
algorithms to solve orthogonal non-guillotine MD-KP instances and are the first to obtain 
exact solutions for some instances from the literature. Using these MD-KP algorithms, 
we develop the first exact algorithm for the orthogonal non-guillotine MD-BPP and are 
the first to obtain exact solutions to several instances from the literature. 
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EXECUTIVE SUMMARY 


This dissertation investigates Multidimensional Packing Problems (MD-PPs): the 
Pallet Loading Problem (PLP), the Multidimensional Knapsack Problem (MD-KP), and 
the Multidimensional Bin Packing Problem (MD-BPP). In these problems, there is a set 
of items, with rectangular dimensions, and a set of large containers, or bins, also with 
rectangular dimensions. Items cannot overlap (share the same region in space), and, 
when packed, must be completely located within the bin. In some cases, we want to 
maximize the value of items packed in a single bin (PLP and MD-KP). In others, we 
want to minimize the number of bins used to pack all items (MD-BPP). 

MD-PPs arise when preparing a shipment of goods in rectangular boxes inside 
rectangular containers, or cutting smaller pieces from a larger stock (also known as the 
One-, Two-, or Three-Dimensional Cutting Stock Problem); allocating resources over 
time; planning the layout of newspaper pages; designing new computer chips; assigning 
processors in parallel computers; and many others. MD-PPs arise in the obvious military 
logistic applications and in others, e.g., campaign planning, where forces available and 
time are the two dimensions involved. 

Most MD-PPs are known to be NP-complete and the related literature is rich in 
heuristics and approximation algorithms. There are efficient algorithms that yield 
optimal solutions for special cases of the general problem. The complexity of some of 
these special cases is still unknown. 

In this dissertation, we implement new techniques, both exact and heuristic, to 
solve instances of PLP, MD-KP and MD-BPP. These techniques are based primarily on 
new theory developed for PLP. 

Initially, we analyze the effect of restricting rotation and the effects of other 
common pattern restrictions on the number of bins required to solve instances of Two- 
Dimensional Bin Packing Problems (2D-BPP). We define the Minimum Size Instance 
(MSI) of an equivalence class of PLP, and show that every class has one and only one 
MSI. We also develop bounds on the dimensions of item and pallet in the MSI of a class, 
and show that a bound used for almost 15 years is incorrect. Applying the newly 
developed bounds on the MSI dimensions, we enumerate all 3,080,730 equivalence 
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classes with an area ratio (AR) bound no greater than 100 boxes. Previous work in this 
area considered only a subset of these elasses. 

We also present new bounding procedures for PLP. Some of these bounds rely on 
new relations among distinet equivalenee elasses of PLP (restrieted and relaxed elasses). 

We develop new heuristies for PLP. The G5-heuristie computes optimal solutions 
to all instanees of PLP with an AR bound of up to 51 boxes, and 99.999% of all possible 
instanees with an AR bound of up to 100 boxes, differing from the optimum solution by 
at most one box in the 0.001% remaining instanees. We develop three other heuristies to 
solve some instanees not solved by the G5-heuristie or by heuristies from the literature. 

After applying the new bounding proeedures and heuristies, 6,952 equivalence 
classes of PLP with an AR bound of up to 100 boxes remain without a proven optimal 
solution. We develop an exact algorithm, the HVZ algorithm, to solve these remaining 
instanees. With this new exaet algorithm and the new bounds, we are able to identify the 
optimal solutions for the remaining instanees. 

We then extend the HVZ algorithm to develop the Diagonal Fill Algorithm (DFA) 
for the Two-Dimensional Knapsaek Problem (2D-KP) and the Three-Dimensional 
Knapsaek Problem (3D-KP). This is the first algorithm to solve instanees of 2D-KP and 
3D-KP from the literature, allowing 90“ item rotation (orthogonal), and without the 
eommon guillotine eut restrietion (non-guillotine). 

We apply the algorithm for MD-KP within a braneh-and-priee algorithm to solve 
instanees of MD-BPP. This is, also, the first algorithm to solve the orthogonal non- 
guillotine instanees of MD-BPP from the literature. For cases where a good solution 
sooner is better than an optimal solution later, heuristie variations of our exaet braneh- 
and-priee algorithm outperform existing heuristies on standard test instanees. 



TABLE OF CONTENTS 


I. MULTIDIMENSIONAL PACKING PROBLEMS.I 

A. INTRODUCTION TO MULTIDMENSIONAL PACKING PROBEEMS.I 

B. PROBEEM DEEINITION.2 

C. TYPOLOGY OP CUTTING AND PACKING PROBEEMS.4 

D. LITERATURE REVIEW POR MD-PP.7 

E. COMMON VARIATIONS OP MD-BPP.II 

1. Orientation.II 

2. Pattern Restrietions.14 

P. COMPEEXITY OP MD-PP.19 

G. OUTEINE OP THE DISSERTATION.21 

IT THE PALEET EOADING PROBLEM.23 

A. PROBEEM PORMULATION AND DEPINITIONS.23 

1. PLP Problem Pormulation.23 

2. PLP Definitions.24 

3. Effieient Partitions and Equivalenee Classes.25 

B. BACKGROUND ON PLP.28 

C. COMPLEXITY OP PLP.29 

D. UPPER BOUNDS ON THE OPTIMAL SOLUTION.30 

1. Simple Bounds.30 

2. Bound Using a Perfect Partition Equivalent of the Pallet.31 

3. Minimizing the Area Ratio Bound on the Equivalence Class.32 

4. Barnes’ Bound.34 

5. An EP Bound.35 

E. SIMPLE HEURISTICS POR PEP.37 

1. One-Block Heuristic.38 

2. Two-Block and Three-Block Heuristics.38 

3. Pour-Block and Pive-Block Heuristics.40 

4. Diagonal and Angle Block Heuristics.42 

P. MORE COMPEEX HEURISTICS.45 

III. EQUIVAEENCE CEASSES IN PEP.47 

A. REPRESENTING EQUIVALENCE CEASSES.47 

1. Existence and Uniqueness of the Minimum Size Instance.48 

2. Identifying the MSI.49 

3. Bounds on the Dimensions of the MSI of an Equivalence Class.50 

4. Identifying the Minimum Size Instance.56 

B. GENERATING EQUIVALENCE CLASSES.57 

IV. SOLVING PEP.61 

A. A NEW SIMPEE HEURISTIC - THE HOEEOW BEOCK HEURISTIC.61 

B. PEREORMANCE OP SIMPEE HEURISTICS AND BOUNDS.63 

C. NEW BOUNDS POR PEP.64 

1. Bounds Based on the Existence of Single Perfect Partitions.64 

2. Bounds Based on Relaxed and Restricted Classes.70 


IX 













































3. Bound Based on Similarity of Classes.73 

4. Extensions to the LP Bound.75 

5. Performanee of New Bounds.76 

D. NEW RECURSIVE HEURISTICS EOR PEP.78 

1. The G5-Heuristio.78 

2. Higher Order Non-Guillotine Heuristies.81 

E. A NEW EXACT AEGORITHM EOR PEP - THE HVZ ALGORITHM.84 

1. Implementation of the HVZ Algorithm.86 

2. Results Obtained with the Algorithm.87 

3. Complexity of the HVZ Algorithm.90 

E. A NOT SO EXACT ALGORITHM.90 

V. THE MULTIDIMENSIONAL KNAPSACK PROBLEM.93 

A. LITERATURE ON SOLVING MD-KP.93 

1. Heuristies and Approximation Algorithms for MD-KP.93 

2. Exaet Algorithms for 2D-KP.97 

B. A MIP EORMULATION EOR 2D-KP.102 

1. Indieating if an item is paeked in the bin.103 

2. Indieating rotation.103 

3. All paeked items he eompletely inside the bin.104 

4. Enforeing no overlapping.104 

5. Implementing the MIP model.105 

6. Improved MIP model.110 

7. Analyzing the MIP model.115 

VI. NEW ALGORITHMS EOR MD-KP.119 

A. A NEW ALGORITHM EOR 2D-KP.119 

1. Implementing the 2D Diagonal Eill Algorithm.120 

2. Computational Results.121 

3. A Variation of the 2D-DEA.122 

B. A NEW 2D-KP HEURISTIC - LIMITING THE NUMBER OE ITERATIONS 122 

C. EXTENDING DEA TO SOLVE 3D-KP.124 

1. Implementing the Three-Dimensional Diagonal Eill Algorithm.124 

2. Computational Results.125 

D. THE LIMITED ITERATION 3D-KP HEURISTIC.127 

E. A LIVE-BLOCK HEURISTIC EOR 2D-KP.127 

1. Implementing the Live-Block Heuristic for 2D-KP.128 

2. Computational Results.129 

3. A More General Case of 2D-KP.131 

VIE THE MULTIDIMENSIONAL BIN PACKING PROBLEM.133 

A. SOLUTION APPROACHES EOR MD-BPP IN THE LITERATURE.133 

B. OBTAINING EXACT SOLUTIONS TO MD-BPP.134 

C. A MORE GENERAL VERSION OP 2D-BPP.142 

VIII. CONCLUSIONS AND PURTHER RESEARCH.145 

A. CONCLUSIONS AND CONTRIBUTIONS.145 

B. SUGESTIONS EOR PURTHER RESEARCH.147 

LIST OP REPERENCES.149 

INITIAL DISTRIBUTION LIST.157 


X 
















































LIST OF FIGURES 


Figure I.l An example of a pattern with guillotine euts.6 

Figure 1.2 Examples of unit squares packed in a larger square.12 

Figure 1.3 Packing items rotated by an angle close to 90°.14 

Figure 1.4 Optimal packing of 4 x 3 items in a 7x7 bin.15 

Figure 1.5 Examples of E*-order packing patterns.16 

Eigure 1.6 Non E*-order pattern used in the proof of Theorem 1.3.17 

Eigure 1.7 Example of packing layouts of 2n 3x3 items and 2n 4x2 items in 7x 5 bins.18 

Eigure II. 1 Eeasible packing for the class of instance (85, 66, 8, 7).25 

Eigure II.2 Optimal arrangement for instances (22, 16, 5, 3), (30, 22, 7, 4), (50, 36, 11, 7), 

and all instances within the same equivalence class.26 

Eigure II.3 Example of identifying segments in a loaded pallet.27 

Eigure II.4 Partitions observed on a packing of instance (8, 5, 3, 2).35 

Eigure II.5 Optimal arrangement for the class of instance (22, 14, 7, 3) provided by the 

one-block heuristic.38 

Eigure II.6 Optimal arrangement for the class of instance (21, 11, 4, 3) obtained with the 

two-block heuristic.39 

Eigure II.7 Optimal arrangement for the class of instance (19, 13, 4, 3) computed with the 

three-block heuristic.39 

Eigure II.8 Orientation of items within blocks in the four-block heuristic.40 

Eigure II.9 Optimal arrangement obtained with the five-block heuristic for the class of 

instance (14, 14, 5, 2).41 

Eigure II. 10 Examples of optimal packing patterns generated with diagonal block 

heuristics.42 

Eigure II. 11 Optimal packing pattern obtained with the angle heuristic for the class of 

instance (20, 16, 7, 3).43 

Eigure 11.12 Initial partial solutions of the angle heuristic for the class of instance (40, 32, 

7, 3).44 

Eigure IV. I Examples of groups of H-boxes covering a perfect partition used in the proof 

of Theorem IV. 1.65 

Eigure IV.2 Eigure used in the proof of Theorem IV. 1.67 

Eigure IV. 3 Example of packing patterns for restricted and relaxed classes.71 

Eigure IV.4 Non E^-order pattern solution for the class of instance (43, 26, 7, 3).81 

Eigure IV.5 Non E^order patterns explored by the HONG heuristic.82 

Eigure IV.6 Eeasible packing pattern for instance (27, 18, 7, 4).84 

Eigure IV.7 Eeasible packing pattern for instance (7, 7, 5, 2).85 

Eigure IV.8 Optimal packing patterns obtained using the HVZ algorithm, for instances 

(86,52,9,5), (95, 92, 11, 8), and (74,46,7,5).89 

Eigure IV.9 Steps using the procedure proposed by Bhattacharya et al [1998].92 

Eigure V.I Typical packing pattern obtained with the packing algorithm described by 

Moon and Moser [1967].94 

Eigure V.2 Using Sequence Pairs to represent a packing pattern for 2D-KP.95 

Eigure V.3 Packing pattern generated with the 4-Block heuristic, proposed by Scheithauer 

and Sommerweiss [1998].96 

Eigure V.4 Two-stage guillotine cutting pattern studied by Gilmore and Gomory [1965].98 


XI 



































Figure V.5 Admissible plaeement loeations according to the ‘left-most downward 

placement’ rule.102 

Figure V.6 This figure represents the overlap of two items, i andj.104 

Figure V.7 Allowed assignments for the indicator variables.111 

Figure VI. 1 Packing pattern obtained when packing items listed in Table VI. 1 in the 

iJxiO bin.120 


xii 







LIST OF TABLES 


Table I.l Packing patterns used in the proof of Theorem 1.3.17 

Table III.l Number of equivalence classes in each group.59 

Table III.2 Distribution of values of b in the MSI in each class.59 

Table IV. 1 Absolute (and cumulative percentage, in the order of application of heuristics) 

performance of simple heuristics on equivalence classes in each group.64 

Table IV.2 Number of instances with an open result in Table IV. 1 bounded by the SHPP 

Bound, in each group.68 

Table IV.3 Number of instances with an open result in Table IV.2 bounded by the SPP 

bound in each group.70 

Table IV.4 Number of instances with an open result in Table IV.3 bounded by the RC 

bound in each group.72 

Table IV.5 Number of instances with an open result in Table IV.5 bounded by the 

CPPRC bound in each group.75 

Table IV.6 Cumulative results of the SHPP, SPP, RC and CPPRC bounds.77 

Table IV.7 Results of individually applying the SHPP, SPP, RC and CPPRC bounds.77 

Table IV.8 Run times obtained with three different heuristics, when solving a selected set 

of problems from the literature.79 

Table IV.9 Number of instances, from table IV.6, without a proven optimal solution, 

solved using the G5-heuristic.80 

Table IV.10 Instances of the set COVER II solved to optimality by the HONG heuristic.83 

Table IV. 11 Number of instances, from table IV.8, without a proven optimal solution, 

solved using the HONG heuristics.83 

Table IV. 12 Run times obtained with the HVZ algorithm and the G5-heuristic for 

selected problems in the literature.88 

Table V.l Description of instances used by Beasley [1985b] and Hadjiconstantinou and 

Christofides [1995].108 

Table V.2 Run times obtained when solving selected instances from the literature, 

described in Table V.l.109 

Table V.3 Comparison of the results of the first and improved models.113 

Table V.4 Packing values for orthogonal versions of instances from the literature.114 

Table V.5 Details of the solutions at the end of the time window, for instances not solved 

within 1,000 seconds.115 

Table V.6 Possible results of the comparisons between items i and], and] and k.117 

Table VI. 1 Description of items to be packed in a 15x10 bin, based on instance 

NGCUT6 [Beasley 1985b].120 

Table VI.2 Comparison of run times and results obtained with the 2D-DFA.122 

Table VI.3 Trim loss and run times presented in Daza et al [1995] and obtained by 2D- 

DFA for eight instances of 2D-KP.123 

Table VI.4 Wasted areas and run times observed using the 2D-FDFA, with limits on 

1,000 and 10,000 backtracks on the verification stage of the algorithm.124 

Table VI.5 Descriptive information of the random instances used to investigate the 

performance of the 3D-DFA.126 

xiii 





























Table VI.6 Optimal values and run times, in seeonds, obtained with the 3D-DFA, 

oriented and orthogonal versions, on 10 random instanees.126 

Table VI.7 Paeking values, and run times, obtained with the 3D-LDFA.127 

Table VI.8 Average area usage obtained with three different bloek heuristics.130 

Table VI.9 Average run times, in seconds, with the five-block heuristic, in the present 
research, and the four-block heuristic, as reported by Scheithauer and 

Sommerweiss [1998].130 

Table VI. 10 Results obtained with 100 instances, item dimensions selected in the range 

[200,400], with the same layout as Table VI.8.13I 

Table VI. 11 Average ratio of packing value by bin area obtained with the G5- and five- 

block heuristics.132 

Table VII. 1 Results for 2D-BPP instances solved with our exact algorithm.137 

Table VII.2 Details of column generation in the application of the B&P algorithm to the 

same instances as in Table VII.1.138 

Table VII.3 Results of instances from the literature solved with the exact algorithm for 

3D-BPP.140 

Table VII.4 Details of column generation in the application of the B&P algorithm to the 

same instances as in Table VII.3.14I 

Table VII.5 Details of instance Iva-18, initially investigated by Ivancic at al (as reported 
by Bischoff and Ratcliff [1995]) and available online at the OR-Library 

[Beasley 2002].142 

Table VII.6 Results of the application of different heuristics to an instance investigated 
by Skalbeck and Schultz (as reported by Beasley [1985c]), and also solved 

by Wang [1983] and Beasley [1985c].143 

Table VII.7 Results for 12 instances of 2D-AP investigated by Beasley [1985c].144 


XIV 
















ACKNOWLEDGMENTS 


I would like to thank all the individuals and organizations that contributed to 
make my PhD program a success story. Even before mentioning a name, I already know 
that I won’t be able to include everybody that should be acknowledged here, mainly 
because it would require doubling the number of pages in this document. I’m not sure if I 
deserve all this attention, but it really makes me proud. 

I credit my parents for teaching me the importance of looking for the “why” 
behind the “what” in all things. 

Glaucia and Leticia, my wife and daughter, thank you for all the support and 
understanding, especially when I was completely absent, although being physically at 
home. 

I’m only reaching the present education level because of the Brazilian Navy’s 
confidence in me. I’ll do my best to show that investing in postgraduate education is a 
strategy that should be continued. 

I also express my gratitude to: 

• The faculty of the Operations Research and Mathematics Departments of 
the NPS, for their fundamental contribution to my education. 

• Professors Alan Washburn, Jerry Brown, Kevin Wood and Craig 
Rasmussen, not only for everything they taught me in lectures, but also for 
their orientation and helpful comments, in making this document look like 
a dissertation. Special thanks to Professor Washburn, who helped clarify 
Theorems IV. 1 and IV.2. 

• Reinaldo Morabito and Guntram Scheithauer, for contributing their 
expertise in packing problems. 

• My friends and colleges at the “Centro de Analises de Sistemas Navais”, 
for their encouragement and continued interest in my research. 


XV 



• Cindy Graham and all others in the International Programs Office, who 
always strive to improve the quality of life for NPS International Students. 

• My fellow PhD students, Mehmet Ayik, Izumi Kobayashi, and Tom 
Cioppa, now with their programs completed, for their encouragement 
when things looked difficult. Special thanks to Kristi and Scott 
Frickenstien, my sponsor in Monterey, for welcoming me as part of their 
family. 

• Ron Del Presto and all the others in the Glasgow Computer Support Group 
for keeping me “logged in.” 

I express a special note of gratitude to Professor Rob Dell, my dissertation 
supervisor, who always went the extra mile to help me complete this demanding task. 
Professor Dell not only provided the motivation for this research, pointed the directions 
to follow, and corrected any deviations, but he also took over the dissertation reviews 
after I returned home with only an incomplete draft in hand. 


XVI 



I. MULTIDIMENSIONAL PACKING PROBLEMS 


A, INTRODUCTION TO MULTIDIMENSIONAL PACKING PROBLEMS 

This dissertation investigates Multidimensional Paeking Problems (MD-PPs): the 
Pallet Loading Problem (PLP), the Multidimensional Knapsack Problem (MD-KP), and the 
Multidimensional Bin Packing Problem (MD-BPP). In these problems, there are a set of 
items, with rectangular dimensions, and a set of large containers, or bins, also with 
rectangular dimensions. Items cannot overlap (share the same region in space), and, when 
packed, must be completely located within the bin. In some cases, we want to maximize 
the value of items packed in a single bin (PLP and MD-KP). In others, we want to 
minimize the number of bins used to pack all items (MD-BPP). 

MD-PPs are encountered when preparing a shipment of goods in rectangular boxes 
inside rectangular containers, or when cutting smaller pieces off some larger stock (also 
known as the One-, Two-, or Three-Dimensional Cutting Stock Problem)', allocating 
resources over time; planning the layout of newspaper pages; designing new computer 
chips; assigning processors in parallel computers; and other applications. MD-PPs arise in 
the military in obvious logistic applications and in others, e.g., campaign planning, where 
forces available and time are the two dimensions involved. There are many other 
applications too (e.g., Dyckhoff [1990]). 

Most MD-PPs are known to be NP-complete [Garey and Johnson 1979], and the 
related literature is rich in heuristics and approximation algorithms. Efficient algorithms 
that yield optimal solutions, for some restrictions, or special cases, of the general problem 
also exist. The complexity of some of these special cases is still unknown. 

In this dissertation, we implement new techniques, both exact and heuristic, to solve 
instances of PLP, MD-KP and MD-BPP. These techniques are based primarily on new 
theory developed for PLP. 


1 



B, PROBLEM DEFINITION 


The basic Cutting and Packing Problem (C&PP) involves two sets, one set of small 
objects, items, and one set of large objects, bins. All items and bins have fixed shapes. The 
problem is how to arrange items within the bins in order to optimize some function, subject 
to constraints restricting items not to overlap, and to ensure the items are fully contained 
inside the bin. There is no difference, in terms of solution strategies, between packing and 
cutting problems (e.g., Dyckhoff [1990]). 

Additional restrictions on shapes and quantities of items and bins available, 
restrictions on certain arrangements, the selection of objective functions, the availability of 
complete information, and the number of dimensions involved generate the variations on 
C&PP encountered in the literature. MD-PPs are special cases of C&PP where both items 
and bins have rectangular shape. We use 2D and 3D when referring specifically to two- 
and three-dimensional problems. 

Some of the most studied MD-PPs are Multidimensional Bin Packing, 
Multidimensional Knapsack, Multidimensional Strip Packing, and Pallet Loading. 

• Multidimensional Bin Packing Problem (MD-BPP). A 2D-BPP instance 
consists of a list / of rectangular items with dimens ions (/,,>v,.) and demand 

d. forallze/ as well as a list B of bins with dimensions (A^,}),) and cost 
forall beB. For a 3D-BPP instance, the items have dimensions {li,w.,h.) 
and the bins have dimensions. The objective is to minimize the total 

cost of the bins used to pack all items. If only one type of bin is available, with 
dimensions (A, 7) or(A,T,Z), the objective becomes the minimization of the 
number of bins used. 3D-BPP is also called the Multi-Container Loading 
Problem. 

• Multidimensional Knapsack Problem (MD-KP). In an instance of MD-KP, 
items have values v., i e I, and only one bin is available. The objective is to 

pack, in the bin, the subset of items with maximum value. If the value of an 
item is proportional to its area, or volume, then an equivalent objective is to 
minimize the unused, or wasted, region in the bin. If d- = 00 ,/e/, then the 
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problem is Unconstrained', otherwise, it is Constrained. This problem is 
different from the Multi-Constraint Knapsack Problem, also called the Multi¬ 
knapsack Problem, where the constraints are defined over possibly independent 
dimensions. Lin [1998] presents a recent survey on multi-constraint knapsack 
problems. 3D-KP is also called the Container Loading Problem. 

• Multidimensional Strip Packing Problem (MD-SPP). In MD-SPP, one of the 
dimensions of the bin is unconstrained (the length in 2D or height in 3D) and we 
want to minimize the unconstrained dimension required to pack all items. 

• Pallet Loading Problem (PLP). PLP is encountered when trying to maximize 
the number of identical boxes (items) with dimensions axb, loaded in a pallet 
(bin) with dimensions XxY where each item has a “this side up” type of 
restriction (e.g., Bischoff and Dowsland [1982]). In this case, items are loaded 
in vertical layers, of the same height, and the problem reduces to finding the 
two-dimensional arrangement which maximizes the number of packed items in a 
layer. PLP is an example of unconstrained 2D-KP with only one type of item to 
pack. 

Although MD-KP and MD-SPP are distinct, an algorithm for MD-KP in n 
dimensions can be used to solve MD-SPP in n dimensions. If an algorithm for 2D-KP is 
available, we can fix the width of the bin and try different values for the length. The 
solution with minimum length, such that all items are packed, is the solution to 2D-SPP. 
Also, algorithms for MD-KP and MD-SPP can determine whether all items on a list of 
items can be packed in a single bin. When using an algorithm for MD-KP, we use the area, 
or volume, of the items as their values. With the algorithm for MD-SPP, we solve for the 
minimum dimension, and if the solution does not exceed the corresponding dimension on 
the bin, then the packing is feasible. 

When packing bins, we require all items to be pushed as much as possible to the 
left, front, and bottom of the bin. An item cannot be pushed any further if it touches the 
border of the bin or another item. This packing pattern is called a Normal Packing Pattern 
[Christofides and Whitlock 1977]. 


3 



C. TYPOLOGY OF CUTTING AND PACKING PROBLEMS 


In an approach similar to the characterization of queuing problems, Dyckhoff 
[1990] proposes “a consistent and systematic approach for a comprehensive typology 
integrating the various kinds of [packing and cutting] problems.” Dyckhoff identifies nine 
main characteristics of this family of problems: Dimensionality, Quantity Measurement, 
Shape of Figures, Assortment, Availability, Pattern Restrictions, Assignment Restrictions, 
Objectives, and Status of Information and Variability. 

Dimensionality: What is the minimum number of dimensions necessary to describe 
the geometry of the packing patterns? This is not necessarily the number of dimensions of 
the items and bins involved. In some cases, although dealing with three-dimensional items, 
we are only interested in the arrangement of these items on a plane, reducing the problem to 
two-dimensional. An example is PLP, where the same two-dimensional pattern is repeated 
on each vertical layer of the pallet. This dissertation covers two- and three-dimensional 
problems. 

Quantity measurement: What is the objective function? It can be the number of 
bins used to pack the items (as in MD-BPP) or it can be the length or height of a continuous 
bin (as in MD-SPP). The Earliest Completion Time Problem, where a set of tasks is 
assigned to multiple workers to minimize the total time to complete the tasks, is an example 
of a continuous quantity, time, being optimized. In instances of MD-PP studied in this 
dissertation, we minimize the number of bins used (MD-BPP), or we maximize the value of 
packing one bin (MD-KP and PLP). 

Shape of figures: What shapes do items and bins have? They can be non- 
rectangular, and even non-regular. The Marker Layout Problem, encountered in the 
garment industry, is an example where items have irregular shapes (e.g., Dowsland and 
Dowsland [1995]). In this problem a large piece of cloth is cut in smaller irregular shaped 
parts so as to minimize leftovers. 

The orientation of items inside bins is also addressed under this characteristic. This 
dissertation only covers rectangles, in two dimensions, and orthogonal parallelepipeds, in 
three dimensions. Also, items can be rotated, but their sides must be parallel to the sides of 
the bin. 
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Assortment: What is the number of different shapes available for items and bins? 
In the most eommon formulation of MD-BPP, all bins have the same shape. In PLP, all 
items have the same shape, but may differ in their orientation. In “The Disseetion of 
Reetangles into Squares” [Brooks et al 1940], items are squares, but eaeh with a different 
size. This dissertation analyzes problems with items and bins having a small assortment of 
different shapes. 

Availability: Are there eonstraints on the available quantities for items and bins? 
MD-KP is an example where the available number of bins is limited. The literature has 
referenees on eonstrained and uneonstrained problems, eonditioned on the existenee of 
bounds on the quantity of items to be paeked (e.g., Beasley [1985a]). This dissertation 
addresses problems with various restrietions on availability of items and bins. 

Pattern restrictions: What patterns or geometrie eombinations ean the items take 
inside the bins? As an example, it is eommon to assume in the eutting stoek problem that 
all euts are guillotine euts. A guillotine cut divides a pieee of larger stoek in two smaller 
pieees with a eut from one side to the other. The reeursive applieation of guillotine euts 
forms a guillotine cut pattern. Figure I.l provides an example of a two-dimensional pattern 
produeed with guillotine euts. This dissertation analyzes the effeet of some pattern 
restrietions. 

Assignment restrictions: Are there restrietions on the possible assignments of the 
items? Compatibility of items being paeked together may limit the number of feasible 
assignments. In other eases, information on all items is not available when deeiding how to 
paek an item. This happens, for example, when loading the items as they are being 
delivered; These are “on-line” problems. This dissertation eonsiders only “off-line” 
problems, in whieh shapes and quantities of all items and bins are known when seleeting 
the paeking pattern. 

Objectives: Is the objeetive funetion to be maximized or minimized? There might 
be a eost assoeiated with the number, or type, of bins used (as in MD-BPP). The total 
quantity of “serap,” or unused material, after eutting items is another eommon eriterion to 
be minimized (as in MD-KP). As stated above, this dissertation addresses both the 
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minimization of the number of bins used, and the maximization of the value of items 
packed in one bin. 




(a) 











fc) 






(b) 











id) 


Figure LI An example of a pattern with guillotine cuts. 

At each step of the cutting process, a larger rectangle is slit in two smaller rectangles, with 
a cut from one side to the other, (a) The original stock is cut in two smaller pieces; (b) and 
(c) subsequent cuts are performed; and (d) pieces are trimmed to their correct size. 

Status of information and variability: Are the exact shapes and quantities known 
with certainty? If only the distribution of the items is known, one of the most common 
objectives is to maximize the expected number of items packed. Coffman and Shor [1990] 
and Coffman and Lueker [1991] exemplify work in this area. This dissertation investigates 
only the deterministic version of the problem. 


After considering these nine characteristics, Dyckhoff proposes 96 problem types 
identified by the four characteristics of dimensionality, kind of assignment, assortment of 
bins, and assortment of small items. 

Dimensionality: 

(1) One-dimensional. 

(2) Two-dimensional. 

(3) Three-dimensional. 
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(N) N-dimensional, N > 3. 

Kind of Assignment: 

(B) All bins and a selection of items. 

(V) A selection of bins and all items. 

Assortment of bins: 

(O) One bin. 

(I) All bins are identical. 

(D) Bins have different sizes. 

Assortment of Small Items: 

(F) Few items, with different shapes and sizes. 

(M) Many items of many different shapes and sizes. 

(R) Many items of relatively few different (non-congruent) shapes and sizes. 

(C) Items with congruent sizes. 

Using this typology, the problems in this dissertation, MD-BPP, MD-KP, and PLP, 
are identified as: 

• MD-BPP: 2/F/•/•or3/V/-/ -. For example, a 3D-BPP with identical bins, and 
a two different items types fall in 3/F///F. 

• MD-KP: IIBIOI- or 1IBIOI-, where we must pack a selection of items in 
one bin. 

• PLP: 2! B ! O ! C , 2 l special case of unconstrained 2D-KP. 

Some of the characteristics of problems approached in this dissertation, namely the 
restriction of rectangular shapes for both items and bins, and finite dimensions for bins, are 
not distinguished within this typology. 

D. LITERATURE REVIEW FOR MD-PP 

The basic C&PP is known to NP-hard, with some specific cases shown to be NP- 
complete in the strong sense. This encourages the analyst to concentrate his work in ways 
to identify special situations where the solution might be obtained in less time than would 
be required by the total enumeration of all possible solutions, or to develop heuristics or 
approximation algorithms [Garey and Johnson 1979]. 
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The operations research (OR) literature is rich in references to C&PP under titles 
like Trim Problem, Loading Problem, Floor Layout Problem, Job Scheduling, and Resource 
Allocation. Sweeney and Paternoster [1992] provide a comprehensive bibliography on the 
subject up to 1990, with more than 400 references. Lodi et al [2002a] survey two- 
dimensional problems. Bischoff and Wascher [1990], Dyckhoff and Wascher [1995] and 
Wang and Wascher [2002] edit special issues of the European Journal of Operations 
Research on the subject. The online library of the Special Interest Group in Cutting and 
Packing [SICUP 2002] is a source of information on recent C&PP work. 

The first references in the literature to this family of problems are related to the 
problem of decomposing a square into incongruent sub-squares; many mathematicians in 
the past considered this to be an unsolvable problem. Brooks et al [1940] are the first to 
model the problem as a network. Meschkowski [1966] shows that decomposing rectangles 
into squares can also be modeled as a network flow problem. Gambini [1999] exemplifies 
present work in this square decomposition problem. See also Bird and Boros [1984] and 
Lins et al [2002] for network-based models for MD-PP. 

In 1939, Kantorovich (Kantorovich [I960]) analyzes a problem he names 
Minimization of Scrap. This is the one-dimensional cutting stock version of MD-BPP, 
under a linear programming framework. In his work, he assumes that a list of feasible 
cutting patterns is available beforehand, and approaches the decision of which patterns to 
select. 

Gilmore and Gomory [1961] present a method for generating “on the fly” the best 
possible patterns for the one-dimensional cutting stock version of MD-BPP, using column 
generation. This is a heuristic procedure, because it uses a rounding scheme for leftover 
fractional solutions. However, in large instances of the problem, the loss in optimality due 
to rounding is expected to be small. Gilmore and Gomory [1965] extend their own work to 
higher dimensions, but only consider patterns generated by multistage guillotine cuts. At 
each stage of the multistage cutting process, guillotine cuts are performed in only one 
direction. Beasley [1985a] and Farley [1990], among others, also investigate algorithms 
based on multistage guillotine cuts. 


8 



Barnet and Kynch [1967] analyze the paeking of axl reetangles within a larger 
reetangle, and present possible solutions to this problem. De Bruijn [1969] studies the 
paeking of n-dimensional brieks within a large n-dimensional box. Brualdi and Foregger 
[1974] extend the work on harmonic brieks. An ajXa 2 X..-x«„ briek is said to be 

harmonic if the integers a^,a 2 ,...,a^ can be rearranged into a[,a' 2 ,...,a[, sueh that 

a] |...|a^ (where c\d signifies that c divides d). Barnes [1979] uses this work to 

propose a new bound for PLP, and to show that for “suffieiently large” problems, this 
bound is exaet. A problem is eonsidered sufficiently large if the dimensions of the pallet 
are signifieantly larger than the dimensions of the item (i.e., min {A, Y}>a*b). 

Christo tides and Whitloek [1977] propose a tree-seareh algorithm for 2D-KP with 
guillotine euts and with items restrieted to a fixed orientation. In their formulation, 
guillotine euts ean be performed in both direetions; their algorithm is based on generating 
all feasible eutting patterns. They also propose the use of Normal Patterns, representing 
left-bottom justified paeking patterns. Herz [1972] presents the same idea with the name of 
Canonical Dissections. 

Wang [1983] presents a different approaeh for enumerating the feasible guillotine 
patterns in 2D-KP. Her algorithm generates patterns by “sueeessively adding the reetangles 
to eaeh other.” See also Oliveira and Ferreira [1990] and Daza et al [1995]. 

Beasley [1985b] proposes the first exaet algorithm for solving 2D-KP without the 
guillotine eut restrietion (non-guillotine 2D-KP). His approaeh is based on a braneh-and- 
bound tree seareh using lagrangean relaxation of a binary integer program (BIP) to 
generate bounds. In his formulation the orientation of items is fixed, although he proposes 
an approaeh to deal with the situation of 90° rotations. Christofides and Hadjieonstantinou 
[1995] use a similar idea, with an improved formulation, but also with fixed orientation. 

Baker et al [1980] propose an approximation algorithm for 2D-PP, and eompute 
asymptotie performanee bounds for this algorithm. Coffman et al [1980], Baker and 
Sehwarz [1983], and Kenyon and Remila [2000] also eonsider approximation algorithms 
for 2D-PP. Chung et al [1982] use a hybrid proeedure, based on 2D-PP, in an 
approximation algorithm for 2D-BPP with fixed orientation, and show that the solutions 
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obtained are, in the worst ease, larger than the optimal solution by a faetor slightly larger 
than 2. 

Several authors investigate different types of heuristies for C&PP. George and 
Robinson [1980] propose a heuristie to paek three-dimensional boxes in eontainers, and 
report using the heuristie to paek “about 800 boxes of up to 20 different types in eaeh 
shipment.” Gehring et al [1990], and Bisehoff et al [1995] also deseribe heuristies for 3D- 
BPP. Bisehoff and Marriott [1990] investigate the effeet of eertain parameters, sueh us 
sorting and ranking polieies, on the performanee of two existing heuristies, and eonelude by 
proposing a new eombined heuristie. Kroger [1995] and Gomez and de la Fuente [2000] 
propose heuristies with genetie approaehes. Healy and Moll [1996] deseribe a heuristie 
based on loeal seareh. Faina [2000] proposes an algorithm based on simulated annealing. 
Hopper and Turton [2001] investigate hybrid heuristies. 

Li and Cheng [1990] propose approximation algorithms for 3D-SPP, whieh 
guarantee results not worse than 3.25 times the optimum height of paeked items. Their 
algorithms divide items into subgroups based on size, and apply different paeking 
proeedures to eaeh subgroup. Miyazawa and Wakabayashi [1997] and [2000] improve 
those algorithms. Li and Cheng [1992] study the on-line version of 3D-SPP. 

Martello et al [2000] analyze new bounds for 3D-BPP, and present both exaet and 
approximation algorithms. Their exaet algorithm is based on a two-level deeomposition 
idea, also used for 2D-BPP [Martello and Vigo 1998], and ean be traeed baek to the 
original ideas of Gilmore and Gomory [1961]. Chen et al [1995] propose a different 
approaeh, a mixed integer program (MIP) for 3D-BPP, although only a small instanee is 
solved. 

Heuristies for solving 3D-BPP are proposed by Ivaneie et al (as reported by 
Bisehoff and Rateliff [1995]), Bisehoff and Rateliff [1995], and Terno et al [2000], among 
others. Terno et al [2000] uses the 4-bloek heuristie as a subroutine in a new heuristie, the 
Parallel Generalized Layer-Wise Loading Approach (PGL-approaeh), to solve the Multi- 
Pallet Loading Problem, a speeial ease of 3D-BPP. Current work in the field is represented 
in Eley [2002], Lins et al [2002b], and Pisinger [2002]. 
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E, COMMON VARIATIONS OF MD-BPP 


We analyze some of the most eommon variations of the general MD-BPP, with a 
diseussion of the implieations of some simplifieations and restrietions. These variations are 
usually related to the orientation of items (if items ean be rotated and how), the types of 
patterns aeeepted when paeking or eutting the items, and restrietions on the number of 
items being paeked. 

We mainly bound the effeets of these variations on large instanees. Therefore, let 
A{L) be the number of bins used to paek a list L of items, when applying algorithm A. Let 
OPT{L) be the eorresponding minimum number of identieal bins neeessary to paek the 
same list L. Define (L) = A{L) / OPT(L) , = max {R^(L) \ OPT (L) = n) , and 

i?" = lim^^^ supi?^. measures the asymptotic worst case behavior of A, also known as 
the asymptotic performance bound for^f. 

1. Orientation 

When positioning items inside a bin, it might be useful to rotate some items in order 
to obtain a better solution. If two items, with the same shape and size, but with different 
orientations, are indistinguishable in the eontext of the problem in question, we say that any 
orientation is allowed. If a different orientation eauses an item to be treated as a different 
item, we say that the problem is oriented [Baker et al 1980]. It is also possible that the 
edges of the items must be loaded parallel to the bin's edges, and only 90“ rotations are 
allowed. This restrietion is usually dietated by paeking or eutting eonsiderations, and is 
ealled the Orthogonal Packing Problem [Baker et al 1980]. 
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Figure 1.2 Examples of unit squares packed in a larger square. 

All small squares have a unit side, and the larger square bins have the minimum known 
dimension to pack the given number of unit squares (after Friedman [2000]). 

Erdos and Graham [1975] show that even when paeking unit squares in a larger 
square, it is possible to improve the solution by allowing rotation. Figure 1.2 (after 
Friedman [2000]) illustrates this situation. In Figure 1.2 (a), 10 squares are paeked in a 
square with side3 + l/V2, and Figure 1.2 (b) has 86 squares paeked in a square with 

side(17 +V7)/2 . Without rotation, only 9, and 81, respeetively, unit squares can be packed 
in the larger squares. A packing of 10, or 86, unit squares in square bins with sides smaller 
than 3 + 1 /V 2 , and (17 + V7)/2, respectively, is unknown [Friedman 2000]. 

In most formulations, even 90° rotations are disallowed. Although adopted in many 
packing and cutting problems, it is often only realistic when cutting pieces of wood, or 
glass, where the orientation of the pieces are important to the final product. In such cases, 
pieces with the same dimensions, but different orientations, are considered as different 
pieces. 

Christofides and Whitlock [1977], besides requiring guillotine cuts in their tree 
search algorithm, also consider the orientation of the pieces to be fixed. Baker et al [1980] 
and Chung et al [1982] assume that the orientation of the smaller rectangles cannot be 
changed in their approximation algorithms, and the asymptotic worst case bounds 
computed are valid only under that assumption. Even more recent work, e.g., Christofides 
and Hadjiconstantinou [1995], Martello and Vigo [1998], Martello et al [2000], still require 
fixed orientation. 
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Except for the obvious conclusions drawn from the work of Erdos and Graham 
[1975], we do not find any literature that analyzes the effeet of restrieting item orientation 
on MD-BPP, when compared with solutions obtained without this restriction. 

Theorem I.l: Eet A be an algorithm for 2D-BPP that requires all items to have fixed 
orientation, while OPT aecepts 90° rotations. Then R^>2. 

Proof: Consider the problem of paeking n rectangles with dimensions 3x2 inside bins 
with dimensions 5x3. With fixed orientation, n bins are necessary. But when allowing 
90° rotations, only n/2 bins are necessary. Therefore, R ; > «/(n/2) = 2 and hm„^„ ■ 

Q.E.D, 

As shown above, algorithms eonsidering only fixed orientation might obtain 
solutions that are twice as large as those obtained by orthogonal algorithms. But allowing 
only 90° rotations may also substantially inerease the number of required bins, as we see 
below. 

Theorem 1,2: Eet B be an orthogonal algorithm for 2D-BPP, i.e., an algorithm that 
provides only for 90° rotations, while OPT aeeepts any rotation. Then 7?" > 2. 

Proof: Consider the problem of paeking n = k^ ,k integer, rectangles with length \ + s and 
width s , with £■ = l/k , in bins with eorresponding dimensions 2x1. In this ease, beeause 
of the length of the items, we cannot rotate them 90° within the bin, and only k items are 
paeked in eaeh bin, with k bins being necessary. But if we rotate the items as elose as 
possible to the vertieal, as in Eigure 1.3, for suffieiently small a, 2k-2 items are paeked, 
and k/2 + 1 bins are necessary (k/2 bins with 2k-2 items, and one bin with k items). 
Then > lim^^^ A:/(A:/2 + 1) = 2 . Q.E.D. 
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Figure 1.3 Packing items rotated by an angle close to 90°. 

This Figure shows 2k - 2 items, with dimensions (^1 + sj x s, and s = \/k, rotated by an 
angle close to 90° packed in a bin with dimensions 2x1. 

In both cases above, if a third dimension is added, with value 1, for both items and 
bins, we observe the results above are also true for 3D-BPP algorithms. 

2. Pattern Restrictions 

The most eornmon type of pattern restrietion is guillotine euts (Figure I.l). Initially 
addressed by Gilmore and Gomory [1965], guillotine euts have been further studied by 
several authors (e.g., Christofides and Whitlock [1977], Wang [1983], Oliveira and Ferreira 
[1990]). 

If we consider the problem of packing 4x3 items inside 7x7 bins, with 90“ 
rotations without a guillotine cut restriction, 4 items can be packed in each bin, as shown in 
Figure 1.4. With guillotine eut restrietions, only 3 items can fit in each bin, increasing by 
1/3 the number of bins required. Therefore, if C is an algorithm for 2D-BPP with guillotine 
eut restrietion, then 7?” > 4/3. 
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Figure 1.4 Optimal packing with non-guillotine cuts allowed o/ 4 x 3 items in a 7x7 bin. 
This layout is not a guillotine cut pattern, and there is no guillotine cut pattern that packs 4 
items. 

Another type of pattern restriction is the I'^'-Order Non-Guillotine Cutting Pattern. 
Arenales and Morabito [1995] define r‘-Order Non-Guillotine Cutting Pattern, or P*- 
Order Pattern, as a pattern generated only by successive guillotine and/or C‘-order cuts. A 
cut is a P‘Order Non-Guillotine Cut, or P‘-order, if it produces five new rectangles 
arranged in such a way as not to form a guillotine cutting pattern, as shown in Figure 1.5 
(a). 

Figure 1.5 (b) shows an example of a C*-order pattern, while Figure 1.5 (c) shows an 
example of a pattern that is not a C*-order pattern. 

We find C*-order patterns provide optimal solutions to all PLP instances with less 
than 52 items (shown in Chapter IV). Therefore, we explore some instances using items 
with three different sizes, and a total of seven items packed in each bin. 
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Figure 1.5 Examples of -order packing patterns. 

(a) represents a E‘-order cut, resulting in five rectangles; (b) is a E^order cutting pattern, 
because it can be obtained by recursively performing E'-order and guillotine cuts; and (c) 
is an example of a cutting pattern of higher order. 

Theorem 1.3: If D is an algorithm based on l®*-order patterns, theni?* > 27/25 . 

Proof: Consider the problem of paeking 3n 29 x 11 items (7), 2n 28 x 23 items (77), and 2n 
41x5 items (777), in bins with dimensions 69 x 39. Using the non U*-order pattern shown 
in Figure 1.6, it is possible to pack In items in n bins. 
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Figure 1.6 Non -order pattern used in the proof of Theorem 1.3. 

This is a non F^order packing pattern, with three 29 x 11 items {!), two 28 x 23 items (IT), 
and two 41 x 5 items (III), in a bin with dimensions 69 x 39. 

If only l®‘-order patterns can be used, then this optimal pattern is infeasible and we 
must investigate other feasible patterns. After verifying that a pattern is feasible, the 
decision on how many bins to fill with a given pattern depends only on how many instances 
of each item are present in the pattern. If two patterns have the same number of instances 
of each item, then they are considered equivalent, even if the arrangement is distinct. We 
only consider patterns that are maximal, in the sense that no additional items can be packed 
in the bin. Table I.l presents the maximal feasible l®*-order patterns in the problem. The 
columns correspond to different patterns; the rows to items; and the entries are the number 
of copies of each item present in each pattern. 



Patterns 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

I 

7 

6 

5 

5 

4 

3 

3 

3 

2 

2 

2 

1 

1 

1 

II 

0 

0 

1 

0 

1 

2 

1 

0 

2 

1 

0 

3 

2 

0 

II 

1 

2 

1 

3 

3 

1 

3 

5 

2 

5 

7 

0 

4 

7 


Table LI Packing patterns used in the proof of Theorem 1.3. 

Columns correspond to different F^order patterns, the rows correspond to different items, 
and the entries are the number of copies of each item present in each pattern. The column 
numbered 1 corresponds to a pattern with seven items of type I, and one item of type III. 

A linear relaxation of the problem of selecting the best set of l**-order patterns to 

minimize the number of bins requires 4n/25bms with pattern 5, 18n/25 bins with pattern 

6, and 5n/25bms with pattern 13. Because a linear relaxation provides a lower bound on 
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the solution for the integer program, at least 27n/25 bins are required, andi?^ >27/25. 

Q.E.D, 

The last type of pattern restriction considered in this dissertation is the requirement 
of connectivity of items of the same type. In 2D-BPP, when connectivity is required, all 
instances of the same item in a bin must be packed together, i.e., they must share a side. 
George and Robinson [1980] “choose a box type and fill as many complete columns” as 
possible. Temo et al [2000] also require connectivity. 

Theorem 1,4: If E is an algorithm requiring connectivity, then 7?" >4/3. 

Proof; In Figure 1.7 (a) we observe the optimal pattern used when packing 2n 3x3 items 
and 2n 4x2 items in 7x5 bins, if connectivity is not required. In this case, n bins are 
necessary. But if connectivity is required, an optimal solution uses n bins packed with the 
pattern in Figure 1.7 (b), and n/3 bins with a pattern like Figure 1.7 (c). Therefore, 

R;>4/3. Q.E.D. 




Figure 1. 7 Example of packing layouts of 2n 3x3 items and 2n 4x2 items in 7x5 bins. 
In (a) connectivity is not required, but in (b) and (c) connectivity is required. 
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F, COMPLEXITY OF MD-PP 


Garey and Johnson [1979, pp. 124-127] show that the one-dimensional bin packing 
problem (ID-BPP) is NP-complete in the strong sense. Because the one-dimensional 
problem can be transformed into higher dimensional cases by adding extra, fixed 
dimensions, MD-BPP is also strongly NP-complete. The above transformation does not 
apply to some of the special cases of MD-BPP, and results concerning the complexity of 
these cases rely on other approaches. As an example, if the items or bins are square, then 
the transformation is not straightforward, because fixing one of the sizes would also fix the 
other, turning it into a trivial problem, at least for orthogonal MD-BPP. 

Li and Cheng [1989] show that 2D-KP remains strongly NP-complete when 
packing squares in a rectangular bin, or packing rectangles into a square bin. Leung et al 
[1990] prove that packing squares inside a square bin also remains strongly NP-complete. 
But their proof, in which the 3-Partition Problem [e.g., Garey and Johnson 1979] is 
transformed into a 2D-KP, requires a large number of different size square items. Because 
the orthogonal problem with only one square size is trivial, and the general cases are 
strongly NP-complete, there must be a number of distinct sizes, greater than 1, where the 
problem becomes hard. 

The transformation of ID-BPP into MD-BPP helps to prove complexity results for 
the latter, but it does not directly offer insight into the real difficulties of solving 
multidimensional problems. In the ID-BPP, the solution is given by partitioning the set of 
items into subsets, with each subset assigned to a bin. The only requirement is that the sum 
of the length of the items in each subset does not exceed a given bound, the capacity of the 
bin. Because addition is commutative, the order in which the items are packed is irrelevant. 
This is easily observed when considering the one-dimensional version of PLP. If the bin 
has length X and the item length /, then the number of items that can be packed is [X//J . 

In the multi-dimensional case, even when the subsets are given, it is still necessary 
to verify the feasibility of packing the items. To verify feasibility, we must solve a MD- 
KP, with the value of each item given by its area. This MD-KP, alone, is NP-complete. 
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The solution of MD-BPP must include a partition of the items into subsets assigned 
to each bin, and the arrangement, or packing pattern, of these items inside each bin. The 
most common way to represent this arrangement is to assign each item to a position relative 
to some reference point in the bin. For example, each item can be assigned a pair of 
coordinates (x/, yt), corresponding to the horizontal and vertical distance to the reference 
point in the bin. If only normal patterns are considered, then the number of positions an 
item can take in the bin is finite, although usually large [Christofides and Whitlock 1977]. 

Another approach to represent the arrangement is using Sequence Pairs [Murata et 
al 1995], where two ordered lists represent the relative position between pairs of items. 
Each of these two lists corresponds to permutations of where n is the number of 

packed items. There are four possible relative positions between items /and j ; j is to the 
right of /, / is to the right of j,j is above /, or i is above j. 

Graphs can also represent packing patterns (e.g.. Biro and Boros [1984] and Lins et 
al [2002]). The main problem with this approach is that different representations can lead 
to the same arrangement, as given by the coordinates of each item [Christofides and 
Hadjiconstantinou 1995]. This adds to the complexity of search algorithms, even when the 
number of solutions is small. 

If we consider only orthogonal problems with normal packing patterns, the 
decisions to solve MD-BPP can be divided in four main types: 

Partition: Which item goes in which bin? The number of possible assignments 
increases as 7}^^. This decision is always present in MD-BPP, and the complexity can only 
be reduced by adding constraints on combinations of items that can be packed together in a 
bin. 

Order: After choosing a partition, an algorithm must select the order in which the 
items are packed, and the number of options goes up with the factorial of the number of 
items in the partition. In PEP, because there is only one type of item, there is no ordering 
decision. 
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Orientation: Each rectangular item can have two distinct orientations in two 
dimensions, or up to six orientations in three dimensions. Because each item can usually be 
rotated independently of the other, there are an exponential number of possibilities. 

Relative Position: After deciding the ordering and the orientation, it is still 
necessary to select the position of each item being packed relative to all items previously 
packed in the same bin. The number of possible positions for placing an item may increase 
with the number of patterns that can be used with the items already packed, and the number 
of different patterns increases with the factorial of the number of items in the partition. The 
eomplexity of this positioning is simplified by rules like “left-most downward” (e.g., 
Christofides and Hadjieonstantinou [1995]). 

Most heuristics and approximate algorithms in the literature reduce the size of the 
solution spaee by using a sorting rule to decide the ordering of items, fixing the orientation 
of the items, or packing items aeeording to layers (e.g., Coffman et al [1980], Chung et al 
[1982], Li and Cheng [1990]). 

Although exact algorithms for most variations of MD-BPP have exponential run 
time, they can significantly differ in terms of complexity because of the way the solutions 
are represented. For example, the algorithm for oriented 2D-SPP in Murata et al [1995], 
using sequence pairs, has complexity 0{n^nf) [Xu et al 1997], while the MIP analyzed by 
Chen et al [1995], when applied to oriented 2D-SPP, has complexity 0(2^") , where n is the 
number of items to pack. 

G. OUTLINE OF THE DISSERTATION 

This chapter introduces MD-BPP, MD-KP, PEP, and related problems. 

Chapter II reviews previous work on PEP, ineluding a review on the state of the art 
of algorithms and bounding procedures. In Chapter III, we define the Minimum Size 
Instance (MSI) of an equivalence class of PEP, and show that every class has one and only 
one MSI. We also develop bounds on the dimensions of box and pallet in the MSI of a 
class, and show that a bound used for almost 15 years is incorreet. Applying the newly 
developed bounds on the MSI dimensions, we present an algorithm to enumerate all 
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equivalence classes with up to 100 boxes per pallet. Chapter IV presents new algorithms, 
both exact and heuristic, and bounding procedures for PLP. 

Chapter V introduces MD-KP with the description of some previous work and 
discusses a MIP for 2D-KP. Chapter VI presents new algorithms for MD-KP, exact and 
heuristic, and compares the performance of these algorithms with others from the literature. 

Chapter VII reviews previous work on MD-BPP, presents an exact algorithm for the 
orthogonal MD-BPP, and describes a new heuristic for 2D-BPP based on ideas presented in 
Chapters IV and VI. 

Chapter VIII provides conclusions and suggestions for further research. 
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II. THE PALLET LOADING PROBLEM 


This chapter reviews previous work on one of the simplest variations of 2D-KP, 
known as the Pallet Loading Problem (PLP). In this two-dimensional problem, all items, or 
boxes, to be packed have identical dimensions; there is only one bin, or pallet. Boxes may 
be rotated 90“ and must be packed with edges parallel to the pallet's edges, i.e., the packing 
must be orthogonal. Using the classification of Dyckhoff [1990], PLP is classified as 
IIBIOIC. 

Manufacturers must solve PLP when selecting the best arrangement of identical 
rectangular boxes, with a “this side up” restriction, on a rectangular pallet. Even without 
the “this side up” restriction, operational considerations may dictate the use of vertical 
layers with the same height. Considerations regarding stability and safety of the boxes 
imply the use of orthogonal packing, e.g., Dowsland [1987] and Nelissen [1995]. PLP is 
also present in some cutting stock and floor design settings. 

Although simple when compared with 2D-KP, the complexity of PLP is still 
unknown. The one-dimensional version of this problem can be solved in constant time, but 
the same is not true for higher dimensions. The emphasis in most of the literature has been 
on finding good heuristic solutions. In the following sections, we present the problem 
formulation, define some concepts related to PLP, briefly review select PLP research, 
discuss the complexity of PLP, and survey bounding procedures and heuristics in the 
literature. 

A. PROBLEM FORMULATION AND DEFINITIONS 

1, PLP Problem Formulation 

To be consistent with the PLP literature, we define some new notation. In each 
instance of PLP, identified by a quadruple (X, Y, a, b), we have a rectangular pallet with 
length X and width Y (X>Y), and a rectangular box with length a and width b (a>b). 
We can assume, without loss of generality, that X, Y, a, b are positive integers [Bischoff 
and Dowsland 1982]. We also assume that at least one box can be packed in the pallet. 
Thus, X>a and Y>b. 
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The optimization version of PLP is; What is an orthogonal arrangement of the boxes 
on the pallet that yields the maximum number of boxes packed? 

The decision version of PLP is; Given an instance of PLP, is there an orthogonal 
arrangement of boxes on the pallet? 

Some authors (e.g., Nelissen [1995], Scheithauer and Terno [1996]) formulate PLP 
in terms of the maximum number of boxes that can be packed on the pallet, without 
explicitly considering the arrangement of the boxes. The main difference between 
considering the arrangement or not is that it could be possible to develop an algorithm that 
computes the maximum number of boxes packed without defining the arrangement. If an 
arrangement is given, it is straightforward to calculate the number of boxes packed. On a 
planning level, we only need to know how many boxes can be loaded on each pallet, but at 
the operational level we must know how to arrange them. Because the complexity involved 
in solving PLP in either approach is presently unknown, we select the operational level. 

2, PLP Definitions 

We define an H-box (V-box) as a box with its largest dimension oriented 
horizontally (vertically). Given an instance {X',Y',a',b') of PLP, N(X',Y',a',b') is the 
number of boxes in an optimal packing, W{X' ,Y' ,d ,b') = X' *Y' - N{X' ,Y' ,a ,b')* a ^b' 
is the wasted area in an optimum packing, UN{X',Y',a',b') is an upper bound on 
N(X',Y',a',b') , and EW{N',X',Y',a',b') = X'*Y'-N'* a *b' is the waste encountered 
when packing N' boxes for W < [(X' * T')/(a'*h')J . Also^^, = [X'/a'J , Ay=\Y'la'\, 

We define a block as a rectangular subset of a packing arrangement such that no box 
is only partially included in the rectangle. In other words, a block partitions the boxes of a 
packing arrangement into two groups, those inside and those outside the block. If all boxes 
in a block have the same orientation (V-boxes or H-boxes), then the block is called a 
homogeneous block [Scheithauer and Temo 1996]. A homogeneous block of V-boxes (H- 
boxes) is a V-block (H-block). 

A hollow block (Figure II.l) contains boxes in one orientation, across one diagonal 
of the block, surrounded by boxes in the other orientation. Each homogeneous block 
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located in the diagonal of the pattern is called a diagonal element block, or diagonal 
element. All boxes with a different orientation than those in the diagonal elements are 
located in main element blocks, or main elements. The unused regions inside the block are 
ealled holes. The hollow bloek is also ealled diagonal block. 
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Figure 11.1 Feasible packing for the class of instance (85, 66, 8, 7). 

Diagonal elements are identified with the letter D. Main elements are identified with the 
letter M. 

3. Efficient Partitions and Equivalence Classes 

The idea of effieient partitions [Bischoff and Dowsland 1982] eomes from the 
observation that some problems, with different dimensions, possess the same arrangement 
of the boxes in an optimal solution. The arrangement depleted in Figure II.2 is an optimal 
arrangement to the instance (22, 16, 5, 3). Shaded regions indieate unused (wasted) areas 
of the pallet. But the same arrangement is optimal to instances (30, 22, 7, 4) and (50, 36, 
11,7), among an infinite number of instances. 
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Figure 11. 2 Optimal arrangement for instances (22, 16, 5, 3), (30, 22, 7, 4), (50, 36, 11, 7), 
and all instances within the same equivalence class. 

Now, if we draw a vertical or horizontal line across a loaded pallet, as in Figure II.3, 
it crosses a number of boxes. If the dimension of a box crossed by the line is a, we call the 
segment of the line contained within the box an a-segment. Otherwise, we call it a b- 
segment. The sum of the segments crossed by a vertical or horizontal line cannot exceed 
the related dimension of the pallet. 

If we consider the possible combinations of a-segments and h-segments obtained 
for each dimension independently, we can define a set of inequalities to be satisfied for the 
arrangement to be feasible, i.e., a set of inequalities that ensure the combination of H-boxes 
and V-boxes does not exceed either the length or width of the pallet. 

Let (n,m) denote an ordered pair of nonnegative integers satisfying 

n*a + m*b<S (II-1) 

for a pallet dimension S, which could be X or Y. Then, the ordered pair {n,m) is called a 
feasible partition of S, i.e., a combination of segments of lengths a and b not exceeding the 
dimension 5* is a feasible partition of S. The set of all feasible partitions of the dimension S 
for boxes of dimensions axb is denoted by F(S,a,b). 
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Figure 11.3 Example of identifying segments in a loaded pallet. 

The horizontal line H -H' crosses 4 boxes, two across the a dimension (two a-segments) 
and two across the b dimension (two b-segments). The vertical line V -V' crosses 5 boxes, 
one across the a dimension and 4 across the b dimension. 

If n and m also satisfy 

0<S-n*a-m*b<b (II-2) 

then (n,m) is called an efficient partition of S [Bischoff and Dowsland 1982], We cannot 
increase an element of the ordered pair {n,m) in an efficient partition without becoming 
infeasible. For a pallet dimension S, the set of efficient partitions of S, denoted 
hy E{S, a, b) , is defined to be the set of all feasible partitions (n,m) satisfying 

n e {0,l,...,[5'/aJ}, andm = \_(S-n *a)lbj . (fi-3) 

Dowsland [1984] shows that if two instances of PLP possess the same set of 
efficient partitions for both the pallet width and length, then both instances share the same 
set of optimal arrangements. This defines a relation in the set of instances of PLP, which is 
reflexive, symmetric, and transitive. Therefore, the set of instances of PLP can be divided 
into equivalence classes, based on the set of efficient partitions. If a solution is known for a 
class representative, then this solution can be used on any other instance in the class. 
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Because multiplying all dimensions by an integer produces a new instance in the same 
class, it is easy to see that each class contains infinitely many instances. 

If, in addition, n and m satisfy 

n*a + m*b-S, (II-4) 

then {n, m) is called a perfect partition of S [Dowsland 1984], The set of all perfect 
partitions of Y is denoted P{Y,a,b) . There is a corresponding set forX In general, each of 
these sets can be empty, but the instance of an equivalence class with minimal dimensions 
contains at least one perfect partition for each dimension, X and Y [Dowsland 1984], This 
is easily observed if we consider an arbitrary instance without a perfect partition for a given 
dimension. In this case, we can reduce the corresponding dimension of the pallet without 
altering the set of efficient partitions. This implies that the new instance, with a smaller 
dimension, also belongs to the same class. 

B. BACKGROUND ON PLP 

In this section, we review some previous work on PLP; a substantial fraction of this 
work deals with developing heuristics and identifying upper bounds for PLP. 

Barnett and Kynch [1967] are probably the first authors to publish a result regarding 
PLP. They consider the “problem of optimal dissection of a large rectangular plane area 
into smaller rectangles having unit width and integral length so as to obtain the least 
waste.” Their main result is that if all boxes have equal integral lengths, then the maximum 
number of boxes packed can be computed in constant time. Barnes [1979] uses the idea 
that packing patterns of axb boxes can be represented by patterns of ax 1 or 6x1 boxes, 
to compute a lower bound on the wasted area present in an optimal packing. 

Brualdi and Foregger [1974] extends the result obtained by Barnett and Kynch 
[1967] to higher dimensions, and consider the case when the axb box has harmonic 
dimensions, i.e., 6 divides a. 

Dowsland [1987a] proposes an exact algorithm for PLP based on a graph-theoretic 
model of the problem. In her paper, she claims, without proof, that PLP is NP-complete. 
The same year, she investigates a combined database and algorithmic solution [1987b], and 
claims to have generated all equivalence classes satisfying a set of restrictions on the pallet 
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and box dimensions (enumerating some equivalence classes more than once). Dowsland 
[1990] also investigates the situation in which there are additional restrictions on loading 
patterns, as when robots are used in the loading process. 

A working paper by Nelissen [Nelissen 1993] discusses the state of the art for PLP. 
More recently, Nelissen [1995] reports a bounding procedure based on a linear program 
(LP) and use of structural information about the problem. 

Tamowski et al [1994] propose a polynomial time algorithm for the guillotine cut 
version of PLP. 

The G4-Heuristic [Scheithauer and Temo 1996] solves 99% of the randomly 
generated test instances they investigate, and solves all the instances in a set defined by 
Dowsland [1987a]. 

Bhattacharya et al [1998] propose a new algorithm that uses a Maximal Breadth 
Filling Sequence. This tree search algorithm is based on packing not individual boxes, but 
a combination of boxes corresponding to an efficient partition of a partial problem, at each 
step of the search. Although they claim the algorithm is exact, we provide a counter¬ 
example in the next chapter and show the errors in their proof. 

C. COMPLEXITY OF PLP 

PLP, regarded as 2D-KP, would be in the class of NP problems. In this case, the 
input would include a list with the repeated dimensions for each box. So, if we are trying to 
pack A boxes, the list has 2N values. But by “simplifying” the problem, we also simplified 
the input requirements. As seen above, every PLP instance can be defined using only four 
integers, and a “reasonable” encoding scheme would require OClogj X) as input size. If 
every solution certificate produced by an algorithm, i.e., the arrangement of the boxes on 
the pallet, is represented by the assignment of pairs of planar coordinates to each box, 
which may require 0((X/6)^) values, it is easy to see that the certificate size is not 
bounded by a polynomial in the input size, and the problem would not even be a member of 
NP [Cook et al 1998, p. 310]. Nelissen [1993] reaches the same conclusion. 
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While the Guillotine PLP is solvable in 0(log2X*log2a) time [Tamowski et al 
1994], no similar result is available regarding the eomplexity of the non-guillotine ease. 

A polynomial-time algorithm for the non-guillotine PLP, if one exists, must eneode 
the paeking arrangement in a eertifieate with size bounded by a polynomial in logi X If it 
eould be proven that no sueh eneoding seheme exists, then it would be possible to show 
that the non-guillotine PLP is not in NP. On the other hand, the seareh for sueh an 
eneoding seheme might lead to identifying a polynomial-time algorithm. 

One possible approaeh for eneoding the paeking arrangement in a eertifieate with 
size bounded by a polynomial in the input size would be to represent the solution as a 
eombination of bloeks, ineluding only boxes with the same orientation (only H-boxes or V- 
boxes), or other patterns that eould be ereated in polynomial time. Some of the eommon 
heuristies for solving PLP involve the use of 1, 2, 4, or more bloeks of boxes with the same 
orientation, or a speeial eombination of bloeks [Nelissen 1993]. In this ease, the planar 
eoordinates of eaeh bloek, together with its dimensions, would define the solution 
arrangement. If the number of sueh bloeks required to represent an optimal solution eould 
be bounded by a polynomial in logi X, then it would be possible, at least, to show that PLP 
is in NP. If it eould be shown that the algorithm produeing those bloeks also had 
polynomial time eomplexity, than we eould show PLP to be in the elass P. 

D, UPPER BOUNDS ON THE OPTIMAL SOLUTION 

The existenee of a tight upper bound on the maximum number of boxes that ean be 
paeked in an instanee of PLP is useful both in heuristies, to verify optimality, and for exaet 
algorithms, to enable bounding strategies that reduees the solution spaee. This dissertation 
introduees some new bounds in Chapter IV. In this seetion, we review some previously 
published bounds. 

1. Simple Bounds 

A simple and intuitive bound is obtained by taking the integer part of the ratio of the 
areas of pallet and box, [(X * T)/(a *h)J. We eall this the Area Ratio (AR) Bound. 
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Although simple to compute, Smith and De Cam [1980] and Dowsland [1985] report that it 
is equal to the optimal solution in less than 15% of randomly generated test instances. 

Another intuitive bound is obtained by multiplying , the maximum number of 

boxes that can be placed in any horizontal row, and , the maximum number of boxes in a 
vertical column, obtaining . If is relatively close to a, then this Maximum 

Product (MP) Bound can outperform the AR bound. The instance (23, 23, 5, 4) is an 
example of this situation, with an AR bound [(23*23)/(5*4)J = 26 and MP bound 

[23/4] *[23/4] = 25. 

2. Bound Using a Perfect Partition Equivalent of the Pallet 

If an instance of PLP presents perfect partitions in both dimensions, the reduction of 
the pallet dimensions to the largest efficient partition can significantly improve the 
performance of the area ratio bound [Dowsland 1984]. In this situation, the dimensions of 
the pallet are not a positive linear combination of the box’s dimensions, and there is always 
some wasted area in each dimension of the pallet. If we compute the minimum waste 
observed in each pallet dimension, and reduce the dimensions accordingly, the new bound 
is much tighter, being “correct for over 70% of common box and pallet dimensions” 
[Dowsland 1984]. 

Let G{S,d,b)= max _^{i*d + j*b}. We call G{S,d,b) iho. Perfect Partition 

{iJ)E.E{S,d,b) 


Equivalent function. Given an instance (X,Y,d,b) of PLP, the reduced dimensions of the 
pallet are given by 



X* = G{X,d,b), 

(11.5) 

and 

Y* = G{Y,d,b). 

(11.6) 


For instance (38, 38, 12, 5), the area ratio bound computed directly is 24. After reducing to 
the usable dimensions to X* = 37 and Y* =31, we obtain the instance (37, 37, 12, 5), with 
an exact bound of 22. 
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3, Minimizing the Area Ratio Bound on the Equivalence Class 

Selecting an instance in the equivalence class that minimizes the area ratio bound 
may provide a tighter bound. Because all instances in an equivalence class can be packed 
in the same way, with the same optimum number of packed boxes, the bound computed for 
one instance is valid for all instances. Proposed by Dowsland [1984], this approach 
produces exact bounds in at least 92% of her 5,000 randomly generated test cases. We call 
this bound the Minimum Area Ratio (MAR) Bound. 

The selection of an instance that minimizes the area ratio bound can be stated as a 

nonlinear integer-programming problem. Given instance (X,Y,d,b), we formulate the 
minimization problem as 


Min[{X^Y)l{a^b)\ 



X-i^a- 7*h> 0, 

\/(iJ)eE{X,d,b), 

(11.7) 

/ * a + (y +1) * h - A > 0, 

y(iJ)eE{X,d,b), 

(11.8) 

(|^A/aJ + 1) *a - A > 0, 


(11.9) 

Y-f ^a-g^b>0, 

'^{f,g)^E{Y,a,b), 

(II.IO) 

f *a + (g + l)*h-T>0, 

V(/,g)e£’(f,a,h), 

(II. 11) 

([f/aJ + l)*a-T>0, 


(11.12) 


X,Y,a,b^Z\ 

The nonlinear objective function, together with integrality constraints on variables, 
can make this minimization problem hard to solve, but Dowsland [1987] and Nelissen 
[1993] show how to convert this problem to a simpler one. 

The first step in the conversion is to allow the variables to take continuous, 
nonnegative values, and to consider only a normalized version of the problem with the box 
having width b always equal to 1. If the optimal solution has fractional rational values, we 
can scale up to obtain only integral values. If decision variables in the optimal solution are 
irrational, we can obtain a rational solution that is arbitrarily close [Nelissen 1993]. 


32 



The second step is to recognize that the length and width of the pallet, in the optimal 
solution, is given by a linear function of the box dimensions, with the coefficients given by 
a pair of perfect partitions. This way, given a pair of perfect partitions for length and width, 

say and(/*,g* j, the objective function can be rewritten as a function of the box 


length only: 


AJi(a) = 


{f *a + f)*{f *a + g*) _ f *g* 


a a 

The first and second derivatives are, respectively. 


+ iUfUa + {r^g+f^f). (11.13) 


AR'{a) = --—^ + 1 * */*, and 


(11.14) 


2 * /* * S'* 

AR\a) = —(11.15) 
a 

Given a pair of efficient partitions, AR{a) is a convex function for positive values 
of a , and the function attains the minimum value at an interior point where AR'(a) = 0, or 
at the boundary of the feasible region. As Nelissen [1993] demonstrates, the domain of a 
can be divided into intervals where one pair of efficient partitions dominates all others. As 
we increase the value of a from its minimum value of one, we move from one pair of 
efficient partitions to another. The algorithm verifies each interval sequentially until the 
instance with minimum area ratio is identified. The feasible region has an open boundary, 
and if the objective function attains a minimum value at this open boundary, we can 
produce an instance with area ratio arbitrarily close to the minimum value, but still 
belonging to the equivalence class. 

One example of a class where the objective function attains a minimum value at the 
open boundary is the class of instance (57,44,12,5) . This instance has AR = 41.8 . When 
minimizing over the equivalence class, the minimum is obtained at instance (23,18,5,2), 
with AR = 4\A. But the Y-partition (0,9) is feasible for (23,18,5,2), and infeasible for 
(57,44,12,5). Therefore, (23,18,5,2) belongs to a different class, but instance 
(23057,18044,5012,2005) belongs to the same class as (57,44,12,5), and has 
^7? = 41.401. 
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4, Barnes’ Bound 


Barnes [1979] proposes a bound based on patterns with axb boxes being 
represented by patterns of axl or hxl boxes. Beeause the solution to problems with unit 
width is easily obtained [Barnett and Kyneh 1967], Barnes eomputes the wasted area 
obtained when paeking only a x 1 or only h x 1 boxes, and uses the greater wasted area as a 
lower bound on the wasted area of the original problem, produeing an upper bound on the 
number of boxes paeked. Barnes also proves that if the dimensions of the pallet are 
“suffieiently large” then the bound is exaet. 

If A is the wasted area in an optimal paeking of a x 1 boxes, =Xmoda and 

s^=Y mod a , then 

yl = min{r^ (11.16) 

The wasted area in an optimal paeking of 6 x 1 boxes, B, is eomputed in a similar 
way. In any optimal paeking of a x b boxes, the wasted area, lk(X,7,a,6), satisfies the 
following system of equations [Barnes 1979] 

W{X,Y,a,b)>mso<.{A,B}, (IT 17) 

W{X,Y,a,b)mo&a = Amo&a ,din& (11.18) 

W{X,Y,a,b)modb = Bmodb. (IT19) 

An example of the applieation of this bound is the instanee (22,18,4,3) . The area 
ratio bound is [(22*18)/(4*3)J = 33, with zero wasted area. The ealeulations required to 
apply Barnes’ bound are 

r^=2, s^=2, ^ = min{4,4} = 4, 

= 1, = 0, B = min{0,6} = 0, 

17(22,18,4,3) > max {4,0} = 4, 

17(22,18,4,3)mod4 = 4mod4, and 
17(22,18,4,3) mod 3 = 0mod3. 

The minimum value satisfying the system of equations is 12. Therefore, the bound 
ean be redueed to ((22*18)-12)/(4*3) = 32 . 
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5. An LP Bound 


Nelissen [1995] reports that in 1987 Isermann presented a method for eomputing 
upper bounds on the number of boxes in the optimal paeking by solving an LP. In this 
approaeh, the pallet is partitioned into vertieal and horizontal strips of unit width. The 
horizontal strips are ealled rows, and the vertieal strips columns. Given a normal paeking 
pattern (left-bottom justified, as defined in Chapter 1) eorresponding to an instanee (X, Y, a, 
b) of PLP, the number of a and b segments in eaeh strip is reeorded as an ordered pair. 
Figure 11.4 depiets an optimal arrangement for instanee (8,5,3,2) (after Nelissen [1995]) 
that demonstrates the use of this notation. For eaeh pair of integers eorresponding to eaeh 
row and eolumn, the first integer indieates the number of a-segments in that unit strip. The 
seeond integer is the number of h-segments. 


■ 

hhhh 


DD 


1,1 




2,1 


1,2 




2,1 



2,1 


Figure IL4 Partitions observed on a packing of instance (8, 5, 3, 2). 

For each pair of integers corresponding to each row and column, the first integer indicates 
the number of a-segments in that unit strip. The second integer is the number of b- 
segments. As an example, the row assigned with (1,2) contains one a-segment and two b- 
segments. Figure after Nelissen [1995]. 

Let the integer variable x, j eount the number of times the feasible partition {i,j) of X 
is observed in a solution. In our example above, Xj ;= 1, Xj j = 1, Xj i = 3, and x^ j = 0 for all 
other partitions inF(8,3,2). Y partitions are eounted in In this example, Jo, 2 ^ 4, 

j = 4, and g = 0, for all other partitions in F(5,3,2). 

Eaeh V-box in the solution is eounted in a rows and in b eolumns, while eaeh H- 
box is eounted in b rows and a eolumns. Any given 1x1 square, aligned with the grid 
and oeeupied by a box, is eounted twiee, onee in the row and another in the eolumn. The 
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product a X / X x^j gives us the number of 1 x 1 squares belonging to H-boxes counted in 
rows with i H-boxes and j V-boxes. If we add over all feasible partitions, we obtain the 
total number of unit squares, or total area, oecupied by H-boxes in the paeking. If we 
divide by the area of an item, a * b , we obtain the total number of H-boxes in the paeking. 
Also, the product b* g* ^ represents the number of 1 x 1 squares of H-boxes in a column 

with/V-boxes and g H-boxes, and the sum over all feasible partitions also returns the area 
occupied by H-boxes. Therefore, the result of both summations must be the same. A 
similar reasoning applies to the V-boxes. Additionally, we relax the integrality eonstraint 
onx,. ^ andy^ g and then formulate the problem as 

Max Z=H + V 
subject to 


z 

{ij) G F{X,a,b) ^ 

(11.20) 

V- z 

(f,g)<^F(Y,a,b) b 

(11.21) 

{iJ)EF{X ,a,h) 

(11.22) 

(f,g)<^F(Y,a,b) 

(11.23) 

Y,a*i*Xij- Y,b*g*yf^g = 0, 

(iJ)GF(X,a,b) (f,g)<^F(Y,a,b) 

(11.24) 

Y^b^j^x.j- =0, 

{iJ)^F(X,a,b) (f,g)GF(Y,a,b) 

(11.25) 

x^ j > 0, \/{i,j)eF{X,a,b) , and 

(11.26) 


(11.27) 


The integer part of H, as defined in (11.20), counts the number of H-boxes, while the 
integer part of V, in (11.21), counts the number of V-boxes. Constraints (11.22) and (11.23) 
require that the number of horizontal and vertieal strips be equal to the vertical and 
horizontal dimensions, respectively. Constraints (11.24) and (11.25) enforce the area 
oeeupied by H-boxes and V-boxes to be the same, as diseussed above. The integer part of 
Z is an upper bound on the number of boxes that can be paeked in the pallet. 
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Nelissen [1995] and Naujoks (as reported by Nelissen [1995]) study and develop 
improvements to this method, with Nelissen reporting that his proposed procedure yields 
the optimal number of boxes packed in 99.86% of 20,000 randomly generated test instances 
with at most 50 boxes, and 99.81% in an additional 20,000 problems, with between 51 and 
100 boxes. 

As we shall see in the next chapter, this record is surpassed by a combination of 
new bounds developed in this dissertation. 

E, SIMPLE HEURISTICS FOR PEP 

Nelissen [1993] reviews the literature on PLP and furnishes most references in this 
section. 

Most heuristics developed so far are based on the idea of combining V-blocks and 
H-blocks. As the possible number of blocks in the solution increases, better solutions can 
be obtained with the development of more complex heuristics, at additional computational 
cost. A tight upper bound on the number of blocks necessary in the optimal solution for 
every PLP is still unknown [Scheithauer and Temo 1996]. 

Some authors use a sample set of randomly generated test problems to measure the 
performance of their algorithms, usually observing some set of restrictions on pallet and 
box dimensions. The most common set of restrictions is first proposed by Dowsland 
[1984] and has been used by other authors, e.g., Nelissen [1993], Scheithauer and Temo 
[1996], Bhattacharya et al [1998], Morabito and Morales [1998]. These restrictions are 

1<X/T<2, (11.28) 

l<a/h<4,and (11.29) 

\<{X*Y)l{a*b)<50. (11.30) 

Nelissen [1995] and Naujoks (as reported by Nelissen [1995]) also investigate instances 
with the area ratio in the range 

51<(X*T)/(a*h)<100. (11.31) 

We enumerate all equivalence classes with AR bound up to 100 boxes, and to solve 
one instance in each class. 
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1. One-Block Heuristic 


In the one-block heuristic, all boxes are paeked with the same orientation. The 
deeision on whieh orientation to use is based on eonstant-time eomputations. If 
X * , then an H-bloek with H-boxes is used, divided into A^ eolumns 

and By rows. Otherwise, a V-bloek with Ay *5^ V-boxes is used, with B^ eolumns and 
A^, rows of boxes. 

y 

Although it is a very simple heuristie, we find that it optimally solves more than 
58% of all problems satisfying restrietion (11.31). An optimal arrangement obtained with 
the one-bloek heuristie is depleted in Figure II.5. 



Figure 11.5 Optimal arrangement for the class of instance (22, 14, 7, 3) provided by the 
one-block heuristic. 

In this example, A^ =3,Ay= 2, B^ = 7, and By=A. 

2. Two-Block and Three-Block Heuristics 

All n-bloek heuristics, for n>2, are based on selecting a size for the first block, 
then for the second block, until the last block is packed. If unused regions exist, then the 
heuristic tries packing in these regions. 

In the two-block heuristic, for each partition {n,m) in E(X,a,b) , we generate two 

blocks: one H-block with n columns and B,. rows, and one V-block with m columns and 

> 

Ay rows. We also generate two blocks, in a similar way, for each partition (n,m) in 
E{Y,a,b), and pick the best solution, i.e., the solution with the most packed boxes. Figure 


38 





II.6 shows an optimal arrangement for the class of the instance (21,11,4,3) obtained with 
the two-block heuristic. 



Figure 11.6 Optimal arrangement for the class of instance (21, 11, 4, 3) obtained with the 
two-block heuristic. 

This pattern corresponds to the efficient partition (2, 1) m£'(ll,4,3), with A^-5 and 

In the three-block heuristic, after computing the results for each efficient partition, 
if there is an unused region that is large enough to fit another block, then the boxes in this 
third block are added to the solution corresponding to that partition, before selecting the 
best solution. Figure II.7 is an example of an optimal arrangement provided by the three- 
block heuristic. 



Figure 11. 7 Optimal arrangement for the class of instance (19, 13, 4, 3) computed with the 
three-block heuristic. 

A third block with two V-boxes is added to the initial solution of the two-block heuristic. 
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3. Four-Block and Five-Block Heuristics 

The four-block heuristic, proposed by Steudel [1979] and Smith and de Cani 
[1980], alloeates a bloek with fixed orientation to eaeh of the four eomers of the pallet, as 
shown in Figure 11.8. Bloeks / and III are H-bloeks, while bloeks II and IV are V-bloeks. 



Figure 11.8 Orientation of items within blocks in the four-block heuristic. 

Blocks I and III are H-blocks, and blocks II and IV are V-blocks. 

Bisehoff and Dowsland [1982] propose an algorithm using four nested loops, based 
on effieient partitions, to eompute the dimensions of the four bloeks. If there is still some 
unused area after pieking dimensions of the four bloeks, the algorithm tries to fit a fifth 
bloek with the best orientation for the speeifie instanee. This is the five-block heuristic. 

Let {L.,Wf be the dimensions, and Ci=f*W., the area of the bloek, for 
i = 1,2,3,4,5 . The pseudoeode for the five-bloek heuristie is: 

For eaeh {n^,mf e E{X,a,b ), L, <— n, *a,L 2 
For eaeh {n 2 ,mf) e E{Y,a,b) , if <— n 2 *b,FV^ <— *a,C^ <— *if 

For eaeh {n 2 ,mfi e E{X,a,b) , L 2 <^n 2 *a,L^ <^m 2 *b,C^<r- *W^ 

For eaeh (n^,mfi e E{Y,a,b) , FV^ <— n^ *b,iV 2 <— *0,0^ <— *FV 2 ,C 2 <— L 2 * W 2 

If no bloeks overlap, then 
Compute L^,W^, andCj 

If Cj + C 2 + C 3 + C 4 + C 5 is larger than the previous best, save this solution. 
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Verifying that there is an overlap among the four initial blocks and computing the 
dimensions of the fifth block can be performed at the same time, because both answers 
depend on the same set of conditions: 


If fy +I 3 > X then 

If + ffy > 7, then there is overlap 
else W,=Y-{W,+ Ify), and L,=X-{L^+ L,) 
else if L 2 +L^> X then 

If Ify + IF 4 > Y, then there is overlap 

else Ify = 7-(Ify + Ify), and fy = X -(fy + Z 3 ). 


The final step in this heuristic computes the usable area C 5 of the fifth, i.e. central, 
block. This is performed by applying the one-block heuristic to instance (7j, W 5 , a, b). 
Figure II.9 displays an optimal arrangement to the class of instance (14, 14, 5, 2) obtained 
with the five-block heuristic. 



Figure 11.9 Optimal arrangement obtained with the five-block heuristic for the class of 
instance (14, 14, 5, 2). 


41 


















4, Diagonal and Angle Block Heuristics 

Nelissen [1993] describes a family of diagonal heuristics, which generate diagonal 


block patterns, as in Figure 11.10. 



Figure 11.10 Examples of optimal packing patterns generated with diagonal block 
heuristics. 

(a) is a simple diagonal solution for the class of instance (15, 13, 4, 3); (b) is a multiple 
diagonal solution for the class of instance (22, 10, 4, 3); and (c) is a supplemented 
diagonal solution for the class of instance (15, 10, 4, 3). 

If the solution to a problem has only one box in each diagonal element, he calls the 
pattern a simple diagonal block solution. If the diagonal elements are composed of more 
than one box, side by side, the solution is called a multiple diagonal solution, as in Figure 
II. 10 (b). If the arrangement with diagonal block pattern is complemented by an additional 
block, as in Figure II. 10 (c), it is called a supplemented diagonal solution. Nelissen [1993] 
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reports the work of other researchers with this heuristic. An important characteristic of the 
diagonal block pattern is its symmetry, with all holes having the same size. 

Nelissen [1993] proposes other heuristics, using the same basic idea, the angle 
heuristic and the recursive angle heuristic, which allow more complex arrangements than 
the diagonal heuristics. The main difference between the diagonal heuristics and the angle 
heuristics is that the arrangement obtained with these latter procedures may not be 
symmetric, and holes can have different sizes, as shown in Figure II.l 1. 



Figure 11.11 Optimal packing pattern obtained with the angle heuristic for the class of 
instance (20, 16, 7, 3). 

The angle heuristic uses three nested loops. The outer loop determines if additional 
boxes can be packed in the pallet, and there is one loop for each dimension. At each step of 
the procedure, a fraction of the current length and width is packed with a partial solution 
computed from the efficient partitions, and three new homogeneous blocks are added to the 
current solution: one at the left lower corner, one to the right, and one above the first block. 
If (/, j) is an efficient partition of the current length, (f, g) is an efficient partition of the 
current width, and i,j,f g > 0, then four possible arrangements are analyzed, depending on 
the selection of the orientation of the boxes for each block, and the relative size of these 
blocks: 

• A jxf block of V-boxes at the lower left corner of the current partial pallet, 
with an ixk block of H-boxes to the right, and a lxg block of H-boxes above. 
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where in the first arrangement (^,/) = ([/*a/h],[ 7 *h/aj) and in the second 
arrangement {k,l) = (\_f * a/hJ, |~ 7 * h / a]), and 
• An ixg block of H-boxes at the lower left corner of the current partial pallet, 
with a jxk block of V-boxes to the right, and a lx f block of V-boxes above, 
where in this third arrangement {k,l) = g*b/a~\,\_i* a/bj) and in the forth 

{k,l) = (lg^b/a\,\i^a/b']). 

The selection of values for k and / determines whether the corner block is longer 
than the block above it, or “higher” than the block at the right. Figure 11.12 (after Nelissen 
[1993]) pictures the four possible cases, for instance (40, 32, 7, 3), X-partition (4, 4) and Y- 
partition (2, 6). 



7.5). 
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(a) solution with a block ofV-boxes in the corner, k = A and I = 2; (b) also a corner block 
with V-boxes, but k = 5 and I = 1; (c) a block with H-boxes in the corner, k = 2 and I = 10; 
(d) also a corner block with H-boxes, but k = 3 and 1 = 9 (after Nelissen [1993]). 

In the angle heuristie, the angle, or seleetion of the type of bloek in the eorner, and 
values for k and / are fixed, and are repeatedly applied in the following steps of the 
proeedure. If a used region remains in the pallet, the one-bloek heuristie is used to finish 
up the paeking pattern. 

In the reeursive angle heuristie, a different angle is applied at eaeh step of the 
proeedure, allowing the ereation of more eomplex paeking arrangements. 

F. MORE COMPLEX HEURISTICS 

When simple heuristies fail to paek a number of boxes equal to the best available 
upper bound, more eomplex heuristies may be useful. Different types of eomplex 
heuristies, usually based on reeursion, are available in the literature. 

Nelissen [1993] proposes extending the reeursive angle heuristie, allowing the use 
of a simple heuristie at eaeh step of the proeedure. In this ease, at every step, the proeedure 
tries a different angle and tests if a five-bloek heuristie yields a better solution. Nelissen 
also ineludes the possibility of eompleting the solution generated with the angle heuristie 
with one or more homogeneous bloeks. This heuristie is named the recursion heuristic. 
The same paper proposes another heuristie, the complex-block heuristic. This heuristie is 
based on a seven-bloek heuristie, originally formed with homogeneous bloeks, but it allows 
the eentral bloek to be an angle bloek, or a bloek generated by another heuristie. 

Seheithauer and Temo [1996] propose the G4-heuristic. This heuristie is a 
reeursive four-bloek heuristie. The G4-heuristie is able to solve all problem instanees 
defined by eonditions (11.28) to (11.30), and able to solve approximately 99% of their test 
instanees. 

Morabito and Morales [1998] propose another applieation of reeursion to a simple 
heuristie. Their algorithm is a reeursive five-bloek heuristie, based on the proeedure 
proposed by Bisehoff and Dowsland [1982]. 
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III. EQUIVALENCE CLASSES IN PLP 

This chapter discusses PLP equivalence classes and analyzes new relationships 
among instances of PLP. 

A, REPRESENTING EQUIVALENCE CLASSES 

Because instances of PLP in the same equivalence class share the same set of 
optimal solutions, once one instance is solved, the solution can be stored in a database and 
retrieved whenever a solution to an instance of PLP of the same class is necessary 
[Dowsland 1987a]. The most straightforward way to identify each equivalence class in a 
database is to encode the set of efficient partitions defining the class. This way, given a 
new instance, it is possible to compute the set of efficient partitions and compare it with the 
entries in the database. One possible problem is that the cardinality of this set increases 
with the number of boxes packed. 

Another approach is to select a unique class representative. This way, only four 
integers are neeessary to represent the class, independent of the number of boxes in the 
optimum packing. But identification of instances belonging to the same class must be 
performed efficiently. 

One option for defining an equivalence-class representative is the instance that 
minimizes the area ratio bound, the Minimum Area Ratio Instance {MARI). But the 
minimization problem can have a solution at an open boundary, or at a non-integral interior 
point, as discussed in Chapter II, and in these cases the dimensions of the MARI can only 
be approximated, when using integers. Different approximations can generate different 
instances within the same class, complicating the identification process. 

Another candidate for equivalence-class representative is the Minimum Size 
Instance (MSI), the instance that minimizes the dimensions of both the pallet and the box. 
We say that instance {X,Y,a,b) is the Minimum Size Instance of a class if for all instances 
{X,Y,a,b) in the same class, X < X,Y <Y,a< a,b <b. 
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1, Existence and Uniqueness of the Minimum Size Instance 


As explained when presenting the Perfeet Partition Equivalent Bound, in Chapter II, 
given an instanee {X,Y,d,b) of PEP we ean obtain the pallet with minimum allowed 
dimensions, X* x 7*, for the given box dimensions, applying the perfeet partition 
equivalent funetion. Therefore, if the dimensions of the box in the MSI, a x h , are known, 
then the dimensions of the pallet are given by X = G{X,d,b) and Y = G{Y,d,b). 
Therefore, the dimensions of the pallet in the MSI of a given equivalenee elass are 
determined onee the dimensions of the box are known. 

We show that the MSI is unique in a elass and its dimensions ean be easily 
bounded, simplifying the proeess of enumerating equivalenee elasses. 

Theorem 111,1: Every equivalenee elass of PEP has one and only one MSI. 

Proof: We initially show that there is no more than one MSI in eaeh elass. Then we show 
that every elass has at least one MSI. 

Suppose and {X 2 ,Y 2 ,a 2 ,b 2 ) are two MSIs in an equivalenee elass. 

By definition, both instanees minimize all dimensions of the pallet and the box 
{X^< X 2 ,Y^<Y 2 ,a^<a 2 ,a^<a 2 and X 2 < X^,Y 2 <Y^,a 2 < a^,a 2 < a^), implying 
Xj = X 2 ,Tj =Y 2 ,a.^ =a 2 ,a^ =‘^ 2 - Therefore, if there is a MSI, it is unique. 

Now eonsider an equivalenee elass. Beeause the dimensions of the pallet in the 
MSI are a funetion of the dimensions of the box in the MSI, the only way for a elass not to 
have an MSI is if there exists one instanee, say {X^,Y^,d,b^) , with minimum length for the 
box (i.e., d<a for all instanees (X,Y,a,b) in the same elass) and another instanee, 
{X 2 ,Y 2 ,a 2 ,b), in whieh the box has minimum width (i.e., b<b for all instanees 

{X,Y,a,b) in the elass). In this ease, a 2 >d and b^>b . The striet inequalities hold 
beeause otherwise at least one of the instanees would have the box with both minimum 
dimensions. As both instanees belong to the same elass, E(X^,d,b^) = E(X 2 ,a 2 ,b) and 

E{Yy,d,by) = E{Y 2 ,a 2 ,b). We show that the MSI ean be identified from these two 
instanees. 
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As Dowsland [1987a] shows, a scaled instance of PLP remains in the same 
equivalence class. After scaling, the dimensions of the pallet and box may no longer be 
integers. Normalizing the width of the box to 1 in the above instances, we obtain instances 

(Xj/hj ,P|/hj ,a/hj ,1) and {X^jb ,¥^1^ ,a 2 lb ,\). Because b^>b and h>0, then 

l/h>l/hi, and this result together with a 2 >a give us aj/h > a/h >a/hi. Because an 
equivalence class is a convex set [Nelissen 1993], there is an instance, possibly fractional, 
{x,j„alb,\) in the elass. If we multiply the dimensions by b we obtain the instanee 
(Xg *h,a,h). We can apply the perfect partition equivalent funetion, obtaining 

X = G(Xj,a,h) and Y = G(Y,a,b) . The instanee (X,Y,a,b) satisfies the requirements to 

be the MSI of the elass. Therefore, the elass has an MSI. Q.E,D, 

As shown above, every class has a unique MSI. And in a proeedure to identify the 
MSI of a elass, it makes no differenee whieh box dimension we ehoose to minimize first. 

2. Identifying the MSI 

The problem of identifying the MSI could be formulated as a IP, but as in the 
minimization of area ratio, diseussed in Chapter II, we can relax the integrality eonstraints 
and eonsider only normalized instanees in whieh b = \. Beeause the dimensions of the 
pallet are functions of the dimensions of the box, and the width is fixed, the problem 
reduees to a one-dimensional problem, where we minimize the box length. Constraints 
(II.7) to (11.12) are used again. But, unlike the area ratio ease, the objective funetion is 
linear, and the optimal solution is attained at an extreme point. Because all coeffieients in 
the problem are integer, the objective is rational. 

Once the optimal solution is obtained, if it is fractional, say (X, T,a,l), with 
a = cld , where the greatest common divisor of c and d equals 1, we ean scale it up and 
obtain an integral solution, {X* d,Y* d,c,d), with minimum integer dimensions. 

If we model the problem as an LP, eonstraints (II.8), (II.9), (II.l 1) and (11.12) can be 
converted to greater than or equal to inequalities if we observe that, for integer-valued 
variables, the minimum surplus must be 1 because all coefficients are integers. 
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Therefore, constraints (II.7) to (II. 12) can be replaced by 


X-i*a-j*b>0. 

^{i,j)eE{X,d,b), 

(III.l) 

i*a + {j + \)*b-X>\, 

y{iJ)eE{X,d,b), 

(111.2) 

(|^x/aj + 1) *a - X > 1, 


(III.3) 

Y-f *a-g*/i>0. 

^if,g)^E(Y,d,b), 

(111.4) 

/ *a + (g + l)*/)-T>l, 

^if,g)^E(Y,d,b), 

(III.5) 

([f/aJ + l)*a-T>l. 


(III.6) 


In this LP, our objective is to minimize a , and we can observe that at least one of 
constraints (III.2), (III.3), (III.5), and (III.6) will be binding in the optimal solution, or we 
could reduce a even further. We call these efficiency constraints. Constraints (III.l) and 
(III.4) guarantee the feasibility of the partitions, so we call them fitting constraints. 

If we are given an integer instance {X',Y',a',b'), we can determine if it is the MSI 
by testing its dimensions against constraints (III.l) to (III.6). If there are fitting constraints 
binding for both X and Y , and at least one of the efficiency constraints is binding, this 
means that we cannot reduce the values of a and b . In this case, instance {X',Y',a',b') is 
the MSI. If none of the efficiency constraints is binding, then we could reduce the 
dimensions, and {X',Y',a',b') is not the MSI. 

As seen above, the identification of the MSI is a one-dimensional problem, up to a 
scalar multiplication, and an integer solution has at least one efficiency constraint binding. 

3, Bounds on the Dimensions of the MSI of an Equivalence Class 

With upper bounds on box and pallet dimensions of the MSI of a class (our class 
representative), we find all equivalence classes with at most a selected number of boxes. 

For instance (X,Y,d,b), let and ^4^, =[^T/aJ. Dowsland [1987a] proposes 

bounds for a and b, a<B^+\ and b< A^+\, when computing all equivalence classes 
with at most a selected number of boxes. Unfortunately, these bounds are incorrect, as can 
be verified with instance (104, 90, 15, 13), MSI of its class. For this instance, A^=6, 

Ay = 6, B^=S, By = 6, with a=B^ + By+\ and b = A^ + Ay+ \ . From a rearranged 
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version of the LP used to determine the MSI, we establish below that a<B+B^+\ and 

X y 

b< + A+ \. 

The LP (Primal) is given as follows: 

effieient partitions on length, i = 0,...,A^. 
effieient partitions on width, / = 0,...,A^,. 

number of V-boxes in partition i of the length, 
number of H-boxes in partition/of the width. 

X, Y, a, b as previously defined. 

Formulation: 

Min b 
subjeet to 


X -i* a- px. * h > 0, 

V/e{0,l,...,4}, 

(111.7) 

/ * a + {px. +1) * h - X > 1, 

V/e{0,l,...,ij, 

(III.8) 

(4+l)*a-X>l, 


(111.9) 

Y - f *a-py^ > 0, 

V/e{0,1,...,4}, 

(III. 10) 

f *a + {py^ +1) * h - 7 > 1, 

V/e{0,l,...,4}, 

(III.ll) 

(4,+l)*a-T>l. 


(III. 12) 


In this ease, we are minimizing b . Beeause the problem ean be redueed to an one¬ 
dimensional problem, it makes no differenee if we minimize a or b , beeause the result is 
the same. 

An inspeetion of eonstraints (HI.7) and (III.8) shows that the addition of the 
eonstraints eorresponding to the same value of i in eaeh set bounds b below by 1, i.e.. 


Indiees: 


f 


Data: 


py 

PYj 


Variables: 
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{X-i*a-px^ */)) + (/*a + {px^ + \)^b-X) = b>\. Therefore, when (Primal) is feasible, it 

has an optimal solution, with objeetive funetion value greater than or equal to 1. In this 
optimal solution, at least four eonstraints are binding beeause it is a four-dimensional LP 
and the variables have no nonnegativity eonstraints [Bertsimas and Tsitsiklis 1991]. 

Beeause the MSI of a elass has one perfeet partition in eaeh dimension, then, at least 
two fitting eonstraints, one in the length and one in the width, are tight in the optimal 
solution. Also, at least one effieieney eonstraint is binding. 

The dual of (Primal) has only four rows, and its bases are 4x4 matriees. This 
eharaeteristie makes it easer to work with the dual when eomputing the bound on b . 

Let s = ( 5 io,..., 5 i^ , 52 o,..., 52 ^ , 53 , 540 ,..., 54 ^ ,^ 50 ,..., 55 ^^, 5 g), be the veetor of dual 
variables of the (Primal). The dual (Dual) of (Primal) is given by 


Max 


subjeet to 


£ (^2,- - ^1,) * i HA + 1) * ^3 + £ (^5/ - ^4/) * / +(4 + 1) * ^6 = 0 , 


(III. 13) 


£ iipXi +1) * S21 - px, * 5 i,.) {{py^ +1) * 55^ -pyf*s,f) = '^' 


(III. 14) 


£K-'^2,)-'^3 =0: 


(III. 15) 


£(V^5/)-'^6 =0 


(III. 16) 


s > 0. 

Let P be the matrix of teehnologieal eoeffieients of the (Primal). Then has the 
following strueture: 

0 ... -4 0 ... 4 4 + 1 0 ... -4 0 ... 4 4 + 1 

-px^^ ... -px^ pXo + ^ ... PXa^ +1 0 -py^ ... -pyA^. pyo ... PPa^. +1 0 

1 ... 1 -1 ... -1 -1 0 ... 0 0 ... 0 0 

0 ... 0 0 ... 0 0 1 ... 1 -1 ... -1 -1 
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In every optimal dual solution, there is an optimal basis that contains one column 
corresponding to a perfect X-partition, and another column corresponding to a perfect Y- 
partition. This follows from the (Primal), in which there is always one binding X-partition 
row and one binding Y-partition row. 

Therefore, two of the column s in the basis look like this: 


1 0 
0 1 


Also, the optimal basis contains at least one column corresponding to a binding 
efficiency constraint in the primal, or otherwise the dual objective function would have 
value zero. Therefore, the basis contains at least one of the following columns: 





-1 

or 

0 

Oj 


-1 


Considering the conditions above, the optimal basis has one of the following 


layouts, up to an exchange in the last two rows: 









10 -1-1 

, 2 ) 

10-11 

, 3) 

1 0 -1 0 

, or 4) 

10-1 0 

0 1 0 Oj 


0 1 0 Oj 


0 1 or 


0 1 0 -1 


Let .6 be a basis, and let = iSp,Sg,s^,sJ be the corresponding vector of basic 
variables. The coefficients of the first two rows of the basis are identified as 
A: = 1,2,/= 1,2,3,4, where k indicates the row and / the column. If the column 

corresponds to a fitting constraint in the (Primal), its coefficients are identified by . 

The cost coefficients for the (Dual) objective function take value 0 for fitting 
constraints, and 1 for efficiency constraints. Therefore, the vectors of cost coefficients 
corresponding to the cases above are 
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1 )( 0 , 0 , 1 , 1 ), 

2 ) ( 0 , 0 , 1 , 0 ), 

3) (0, 0, 1, 0), and 

4) ( 0 , 0 , 1 , 1 ). 

In all four cases, we ean reduce the system of equations to a 2 x 2 system. 

Case 1) The system is given by 



Ki * Sp + Ki * \ = 0 

(111.17) 


Kl Kl * + Ki *^r+ ^2,4 * = 1 

(111.18) 


Sp-s^-s^ =0 

(111.19) 



( 111 . 20 ) 

We use 

= 0 and , and obtain the following system; 



(^1,3 + ^1,1) * ■^. + (blA 

( 111 . 21 ) 


(^2,3 + ^2,1) * ■^. + (^2,4 + ^2,l) * ■^^ = 1 • 

( 111 . 22 ) 

Case 2) 

The system is given by 



Ki * Sp + Ki * + ^1,3 * + Ka * = 0 

(111.23) 


Ki *^p+ Ki * Sq + Ki Ka * = 1 

(111.24) 


Sp—s^+s^=Q 

(111.25) 


^,= 0 . 

(111.26) 

We use 

= 0 and s^=Sp+s^, and obtain the following system; 



(\3+\l)*'^;,+(\3+\4)*'^, =0 

(111.27) 


iKi + ^2,1) * + (^2,3 + ^2,4 ) * ■^^ = 1 • 

(111.28) 

Case 3) 

The system is given by 



K * + Ki * + ^1,3 * + Ka * = 0 

(111.29) 


Ki *Sp+ ^2,2 * + Ki *^r+ Ka * = 1 

(111.30) 


5^-5, =0 

(111.31) 
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^,+^,=0. (III.32) 

We use Sp = and = -s^, and obtain the following system; 

=0 (III.33) 

(\ 3 +\l)*'^r+(\ 4 -\ 2 )*'^. =1- (III.34) 

Case 4) The system is given by 

Kl*Sp+K'2^\+K^*^r+ Ka * = 0 (III.35) 

Kl *Sp+ hj 2 * + ^2,3 * ^. + Ka * = 1 (III.36) 

=0 (III.37) 

^,-^.=0. (III.38) 

We use Sp = and =s^, and obtain the following system: 

(\ 3 +^u)*'^.+(\ 4 +\ 2 )*'^. =0 (III.39) 

(\ 3 +\l)*'^r+(\ 4 +\ 2 )*'^* =1- (III.40) 


In eaeh of the four cases, let d be the determinant of the 2x2 matrix. The matrix is 
a basis and all elements are integers, so | J| > 1. Therefore, the respective optimal solutions 
of the (Dual) are 

1) = (-(^1,1 + Ka) + (Kl + ^ 1 , 3 ))/^ ^ 1^1,3 - ^1,4 I ^ 4 + 1 . 

2) = (Ki -hi 4 )/d < |hi 1 -hi 4I < 4 , 

3) ■y. = (hi, 2 -Ka)/ d < |hi ,2 -hi, 4 ] < 4 , and 

4) = (-(hi_4+hi2) + (hi_3+hi4))yt/< (hi,3+hi4)-(hi4+hi_2) < + A^+\. 

In case I), both coefficients are nonnegative, corresponding to efficiency 
constraints, and one can take value 0. Therefore, the maximum dual objective function 
value that can be attained is A^+\^ 
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In cases 2) and 3), all coefficients are nonpositive, corresponding to fitting 
eonstraints, and one coefficient, in eaeh case, can take value 0. Therefore, the maximum 
value that can be attained is . 

In case 4), if we consider the order of the rows as presented in (111.35) to (111.38), 
the result follows because (b^^+b^^) is computed over constraints in X, taking maximum 

value A^+\, and (hj 4 +6; 2 ) is computed over constraints in Y, taking minimum value -A^. 
If the order of the rows is exehanged, the values obtained are also exchanged, with 
(hj 3 +hjj) taking maximum value A^+l and {b^^+b^ 2 ) taking minimum value -A^. 

Considering all four oases, we verify that A^ + A^+l is an upper bound on all 

optimal solutions of the dual, and an upper bound on the optimal objeotive function value 
in the (Primal). Because the primal objective is minimizing b in the equivalence class, 
then the value of b in the MSI for all equivalence classes, satisfies; 

b<A^ + A^,+\ (III.41) 

If we seleot to minimize a in the (Primal), then the derived upper bound for a is 
+ By +1. We obtain the bounds for X and Y by oombining the bounds oomputed for a 

and b and the fitting eonstraints in the (Primal). 

Because the bounds used by Dowsland [1987a] are inoorrect, we might observe 
some differences when analyzing the solutions of the classes defined by restrictions (11.27) 
to (11.29). 

4, A Simple Algorithm to Identify the MSI 

Previously we presented an LP formulation for the problem of identifying the MSI 
of a class. This model helped us develop bounds on the sizes of box and pallet in an 
equivalence class. These bounds enable an even simpler method for identifying the MSI. 

Given an instance of PLP, {X,Y,a,b) or the corresponding set of efficient 

partitions, we can test values for b , starting at 1 , and compute the other variables, until the 
MSI is found. The algorithm operates with two main loops. The outer loop seleets values 
for b , from 1 to min{h, A^ + Ay+\} . For each value of h , we eompute the range of a , R~, 
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given by R~={ae 


B * 


+ 1 ) 


<a< 


«s,+i)*6-i)/4 


The second loop 


enumerates values for a in i?-. With a and b, we compute X = G{X,a,b). If the 

selected values for X, a, and b satisfy the effrciency constraints, repeat the same 
computations for Y , or otherwise try the next value for a . If the inequalities for Y are not 
satisfied, continue with the procedure. If satisfied, then instance (X, Y, a, b) is the MSI. 
This algorithm is simple to implement, with complexity 0(5^), and does not require 
setting up an LP. 


B. GENERATING EQUIVALENCE CLASSES 

Dowsland [1987b] works with a subset of approximately 8,000 equivalence classes 
with MAR bound of up to 50 boxes. Scheithauer and Temo [1996] work with a randomly 
generated subset of approximately 50,000 equivalence classes with MAR bound up to 100 
boxes. Instead of generating random instances, or working with a subset of the problems 
with a given size, we enumerate all equivalence classes with up to 100 boxes per pallet, as 
defined by equation (11.31). Also we use the MSI to uniquely identify each class and, 
therefore, record only one instance per class. 

If A is the maximum number of boxes that can be packed on a pallet, we have 

4 + 4<A + l,and (III.42) 

X y 

B+B<2N. (III.43) 

We recall some definitions to demonstrate these bounds. B^ i^y) is the maximum 

number of items that can be placed side by side across the length (width) of the pallet. 
Therefore, B^ <B^<N and By+B^< 2N. Also, any optimal must have at least (A^) 

items placed side by side across the length (width) of the pallet so A^* Ay< N. If 

4=0, 4<Aand4 + 4<A. If 4>I, A^<N/Ay and A^+A^< Nj A^ +A^,< N+ \. 

Our PLP Equivalence Class Generation Algorithm (PLP-ECGA) has six main 
loops, and uses an ordered list to maintain the distinct generated classes for given values of 
a and b . The outermost loop determines the values for b, and goes from 1 to A+2, 
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because A^ + Ay<N + \ (Equation III.36) and b< A^ + A^+\ (Equation IIL35). The 

second loop select values for a, from b+\ to 2N, except when b = \, when a can also be 
equal to 1. If the greatest common divisor (GCD) of a and b is greater than 1, then the 
second loop proceeds to the next value for a. Otherwise, the ordered list, with all generated 
classes, is emptied. The third and forth loops select among all the possible perfect 
partitions of the width, and define the value for Y. The fifth and sixth loops select among 
the perfect partitions of the length, and define X. If instance {X, Y, a, b) is the MSI; has an 
area ratio bound within the limit; and has not been generated before, as verified with the 
ordered list, then it is included in the list and is recorded. The list is necessary because 
different combinations of a and b can yield the same values for X and Y. 

It is possible to verily through the algorithm that the number of equivalence classes 
is bounded by a polynomial in N, albeit a large polynomial. There are 0{N^) ways of 
assigning values to a and b, corresponding to the number of pairs of relatively prime 

IN 

numbers less than or equal to 2N. More precisely, the number is given \)y'^(/){k), where 

k=\ 

(l){k) is the Euler phi-function, which gives the number of integers less than k that are 
relatively prime to k [Gallian 1998]. The loops corresponding to the width are executed 
0{N^) times for each pair a and b. The same happens with the loops corresponding to the 
length. Therefore, the number of equivalence classes, with area ratio bound up to N, is 
bounded above by a sixth-degree polynomial in N. But because the algorithm generates 
many instances from the same class, and the same instance more than once, empirical 
results suggests that the number of equivalence classes might increase with X"*. 

The instances generated with the PEP-ECGA procedure are divided in groups of up 
to 10, 20, 50 and 100 boxes per pallet, as defined by the AR bound. Table III.l presents in 
the second column the number of equivalence classes of PEP in each group. The third 
column contains the time required, in seconds, to generate the equivalence classes within 
each group on a Pentium III 600 MHz personal computer. The dimensions of the pallet and 
box in each MSI are stored for future reference, including the work in the next chapter. 
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Maximum Number of 

Number of Classes iu 

Ruu Time to Geuerate 

Boxes iu each Group 

each Group 

all Classes (Sec) 

10 

662 

0 

20 

7,309 

3 

50 

216,095 

295 

100 

3,080,730 

14,667 


Table III.l Number of equivalence classes in each group. 

The first column represents the maximum number of boxes in each group; the second 
column represents the number of equivalence classes in each group; and the third column 
contains the time, in seconds, required to generate all classes in each group. 


Table III.2 presents the distribution of eiasses in each group, where the MSI is 
defined with b smaller than or equal to 1,2, 5, 10, 20, and 50. 


Number of 
Boxes 

Number of 
Classes 

b = \ 

b<2 

b<5 

6 <10 

6 <20 

6 <50 

10 

662 

92 

276 

609 

662 

662 

662 

20 

7,309 

520 

1,760 

4,873 

6,659 

7,309 

7,309 

50 

216,095 

6,362 

23,270 

71,686 

119,298 

182,870 

216,095 

100 

3,080,730 

46,300 

174,177 

544,004 

964,673 

1,710,574 

2,822,767 


Table IIL2 Distribution of values of b in the MSI in each class. 

The first column defines the maximum number of items that can be packed in an instance in 
the group of classes covered, as given by the area ratio bound. The second column lists the 
number of distinct classes in each group. The following columns present the number of 
classes where the value ofb in the MSI is less than or equal to I, 2, 5, 10, 20, and 50. 

When considering instances of PLP with at most 100 boxes, in 91% of the 
equivalence classes the value of b in the MSI is less than or equal to 50. 

In the next chapter, we develop new bounds and new algorithms for PLP, solving 
all instances generated with the PLP-ECGA procedure. 
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IV. SOLVING PLP 


In this chapter we present a new exaet algorithm, new bounding proeedures, and 
propose a set of new heuristies. One of the new heuristies, the G5-heuristie, optimally 
solves all PLP instanees with at most 50 boxes in the paeking pattern, and generates 
solutions that differ from the optimal solution by at most one box for all problems with 100 
or fewer boxes paeked. 

A, A NEW SIMPLE HEURISTIC - THE HOLLOW BLOCK HEURISTIC 

As deseribed in the previous Chapter, both the diagonal bloek and the angle 
heuristies are based on plaeing bloeks of boxes, with a given orientation, along the diagonal 
of the pallet, surrounded by boxes with the opposite orientation. The diagonal heuristie 
restriets eaeh diagonal bloek to have a width of only one box; the angle heuristie is 
reeursive in nature, and has longer run time, when eompared to the diagonal heuristie. 

We propose an alternative, the Hollow Block (HB) heuristie to solve PLP using 
diagonal bloek patterns. This new heuristie has more flexibility than the diagonal bloek 
heuristie beeause it allows the diagonal elements to have more than one box aeross the 
width, and aehieves shorter run times than the angle heuristie beeause it only looks for 
patterns generated by perfeet partitions of the length and width. This heuristie is 
speeifieally designed to be used within a more eomplex heuristie, where the eomplete 
arrangement of boxes in the pallet eombines many bloeks with different patterns. 

The heuristie works by seleeting eompatible pairs of perfeet partitions for both 
length and width, and uses these partitions to define the dimensions of the elements of the 
hollow bloek. Let (i,j)eP(X,a,b), for z>0 and 7>0, and (f,g)eP(Y,a,b), for 
f >0 and g>0, be the seleeted perfeet partitions. If i*a< j*b and g*b< f *a, the 
diagonal elements are formed by H-boxes, and the main elements formed of V-boxes. If 
j*b<i*a and / *a< g*b, the diagonal elements are formed by V-boxes, and the main 
elements formed of H-boxes. Otherwise, there ean be only four bloeks, two with H-boxes, 
and two with V-boxes. 
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After defining the eomposition of the diagonal elements, the heuristie determines 
whether it is feasible to ereate main elements with the neeessary dimensions to generate the 
hollow bloek. 
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Figure IV.l Hollow block pattern for the instance (85, 66, 8, 7). . 

As seen in Figure IV.l, if there are d diagonal elements in a pattern, then there are 
d *{d -\) main elements in the pattern. This happens beeause if we order the diagonal 
element from left to right, with 1 being the leftmost bloek and d the rightmost, eaeh 
diagonal bloek i has d-i main elements to the right, and d-i above, or 

d 

'^2*{d -i) = d *{d -\) main elements. If the diagonal element is formed by V-boxes, as 

i=\ 

in Figure IV.l, it is feasible to ereate the main elements if /sOmod(t/-l) and 
g sOmod(t/-l). At this point of the heuristie, the value of d is still unknown, and the 
heuristie tries values that divide GCD(i, g) , the greatest eommon divisor of i and g. If the 
diagonal element is formed by H-boxes, the same eonsiderations are valid, but usingy and/ 
instead. In the example in Figure IV.I, / = 8, g = 6 and d= 3. 
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The pseudocode for the HB heuristic is: 


BestjSolution <— 0 

For each (i,j) e P(X,a,b), / > 0,7 > 0 
For each (f,g)eP(Y,a,b), f >0,g>0 
If i*a< j*b and g*b< f *a, diagonal block is H-block 
For d from 2 to GCD{j, /) +1 
S <^d*ii*g + j*f /{d-F}) 

If 5* > BestjSolution then update Best Solution 
If j*b<i*a and/*a<g*/), diagonal block is V-block 
For d from 2 to GCD{i, g) +1 
S ^d*{f* j + i*g/{d-\)) 

If 5* > BestjSolution then update Best Solution 
Otherwise, the solution has only four blocks 

This heuristic has complexity similar to the two-block heuristic, because it also 
searches for the best combination of partitions among the efficient partitions of length and 
width. 

B. PERFORMANCE OF SIMPLE HEURISTICS AND BOUNDS 

For each equivalence class, we determine whether an optimal solution, verified with 
easily computed bounds, can be found using a simple heuristic. We use the one-, two-, 
five-block, and HB heuristics, together with the AR bound, the MP bound, Barnes’ bound, 
and the MAR bound. We first compute all bounds and select the best one. Then we apply 
the heuristics in the order of increasing complexity: one-block, two-block, hollow-block, 
and five-block. If the bound is not attained by a heuristic, then the next one is applied. 

The results are listed in Table IV. 1. The first two columns are the same as in Table 
III.2. The following four columns have the number of instances solved to optimality using 
the simple heuristic listed in the column header. The last column contains the number of 
instances without a proven optimal solution, and are, therefore, instances where a more 
complex heuristic, or a better bound, can possibly produce some improvement. 


63 




Number 

Number 

Oue-Block 

Two-Block 

HB 

Five-Block 

Classes with 

of Boxes 

of Classes 

opeu results 

10 

662 

469 (70.8) 

166 (95.9) 

19 (98.8) 

8 (100.0) 

0 (0.0) 

20 

7,309 

4,646 (63.6) 

2,156 (93.1) 

236 (96.3) 

203 (99.1) 

68 (0.9) 

50 

216,095 

128,204 (59.3) 

63,322 (88.6) 

4,455 (90.7) 

13,291 (96.8) 

6,823 (3.2) 

100 

3,080,730 

1,812,852 (58.9) 

840,019(86.2) 

45,405 (87.7) 

225,929 (95.0) 

156,527 (5.0) 


Table IV, 1 Absolute (and cumulative percentage, in the order of application of heuristics) 
performance of simple heuristics on equivalence classes in each group. 

The first two columns are the same as in Table III.2. The next four columns contain the 
number, and cumulative percentage, of classes with optimal packing computed by a simple 
heuristic and verified with the AR bound, the MP bound, Barnes’ bound, or the MAR 
bound. The last column contains the number of classes with the best upper bound larger 
than the best packing pattern generated by a simple heuristic. For example, the first row 
shows that among the 662 distinct equivalence classes with up to 10 boxes, the one-block 
solved, to optimality, instances in 469 classes (70.8%), the two-block solved an additional 
166 instances, totaling 635 classes (95.9%) solved with these two heuristics. The HB and 
five-block heuristics solved instances in the 27 remaining classes (4.1%), with up to 10 
boxes packed in the pallet. 

Considering instances with up to 100 boxes per pallet, the one- and two-block 
heuristics combined generated optimal arrangements in 86.2% of the equivalence classes. 
Adding the results of the other two heuristics, HB and five-block, 95.0% of the instances 
are solved to optimality by simple heuristics, and the result confirmed by simple bounds. 
This percentage does not include the cases where a better bound could prove optimality. If 
we consider the problems with at most 50 boxes, 96.8% of the instances are solved to 
optimality by simple heuristics. 


C. NEW BOUNDS FOR PLP 

In this section, we introduce new bounds for PLP. As seen in Table IV. 1, only 5% 
of problems with 100 or fewer boxes remain without a proven optimal solution after 
applying simple heuristics and bounds. But this still represents more than 150,000 classes. 
In order to better identify the instances where a heuristic achieves the optimal result, but is 
not confirmed by a simple bound, we analyze and propose a set of new bounds. 


1. Bounds Based on the Existence of Single Perfect Partitions 

These bounds are applicable when, given an instance {X',Y',a',b'), there is only 
one perfect partition in the width (or length) of the pallet, and packing 
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N' = UN(X',Y',a',b') boxes produces wasted area, EW{N',X',Y',a',b'), smaller than the 
corresponding dimension Y (or X) of the pallet. 

The first case considered is when this single perfect partition is composed of only 
V-boxes or H-boxes. We call this partition a Homogeneous Perfect Partition. In this case, 
we can reduce the width or length of the pallet, and apply one of the existing procedures to 
compute a new bound for this smaller instance. If necessary and possible, we repeat the 
reduction process. 



Figure IV 2 Examples of groups of H-boxes covering a perfect partition used in the proof 
of Theorem IV. L Here =10 and the dashed lines are a unit column (width 1). 


We prove the case for the width, with H-boxes. 

Theorem IV.l; Let (X',Y',a',b') be an instance of PLP, with N' = UN(X',Y',a',b') and 

EW{N',X',Y',a',b')< X', and the only perfect partition in Y' is given by B'^^b' = Y'. 
Then 

N{X', Y',a, b') = B\, + N{X' - a, Y', a, b') 

Proof; The pallet can be partitioned into X columns of unit length, each of which is 
composed of Y unit squares, as illustrated by the dashed lines in Figure IV.2. In a normal 
packing, every unit square on the pallet is either completely covered or uncovered by a box. 
We first observe there must be at least one unit column with zero waste because 
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EW{N',X',Y',a',b') < X'. Any such unit column with zero waste must be eovered with 
H-boxes beeause this eorresponds to the only perfeet Y-partition. 

If there is a group of H-boxes eompletely aligned in an optimal solution, as in 
Figure IV.2 (a), it is easy to see that we ean detaeh the bloek formed by this group, whieh 
has By boxes, and reeonneet whatever is on either side of the bloek. The redueed instanee 

has solution N(X' -a',Y',a',b') , and the eombined solution is B'^ + N{X' - a ,Y' ,a ,b'). 

If the group of H-boxes is present in an optimum solution in a more arbitrary shape, 
as in Figure IV.2 (b), then we ean transform this solution to another, with the boxes 
forming a homogeneous bloek. Given an arbitrary group of B'^ H-boxes, sueh that the 

horizontal eoordinates of the all boxes in this group overlap in at least one unit of length, 
we perform the transformation by initially removing these B'^ H-boxes from the pallet. 

This operation partitions the boxes in the pallet in two sets: those to the left of the removed 
bloek, the left set, and those to the right, the right set. In the next step of the 
transformation, all the boxes of the right set are pushed to the left, until they toueh a box 
from the other set. Suppose that the boxes are pushed by a distanee d < a', and eannot be 
pushed any further. Then there are at least two boxes that were originally at a horizontal 
distanee d from eaeh other. Let i e left set and j e right set be these two boxes. If we divide 
the width in unit rows, then a portion of both i and j must be eontained in at least one unit 
row, or otherwise they would not be touehing when one is pushed to left. Figure IV. 3 (a) 
exemplifies this situation, although the orientation of the boxes involved ean be different. 
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Figure IV. 3 Figure used in the proof of Theorem IV1. 

(a) Shows the horizontal distance, d, between boxes i and j, and one unit row in which both 
boxes overlap; (b) indicates that at least in one unit column, the width is completely packed 
with H-boxes ; (c) and (b) are examples that show that an H-box cannot cover the indicated 
unit square, and not overlap with boxes i and j. 

Between the two boxes in the original paeking though, there was at least one unit 
eolumn eompletely eovered with H-boxes, as in Figure IV.3 (b). Therefore, at least one 
unit of the unit row segment, between i and j , is eovered by an H-box. But we eannot fit 
an H-box in that region without overlapping with one /or j , as seen in Figure IV.3 (e) and 
(d). This implies that the distanee between /and j is at least a', a eontradietion to the 
initial assumption that the original distanee was d < a'. Therefore, the movement of the 
boxes only stops after the right set moves a distanee of at least a' units. This ereates an 
empty region at the right edge of the pallet with length at least a' , where the removed 
group of H-boxes ean be plaeed, after being aligned. Figure IV.2 (e) shows the puzzle-like 
result of removing the group of H-boxes. Q.E.D. 

Corollary IV.l: Let {X',Y',a',b') be an instanee of PLP, with N' = UN{X',Y',a',b') and 
EW{N',X',Y',a',b') < X' - j * a'. If the only perfeet partition in Y is given by *b' = Y', 
then 

N{X',Y',a',b') = j * B'y + N{X' - j * a ,Y',a',b'). 

This result follows direetly if we apply reeursion to the previous result. 
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The cases of homogeneous perfect Y-partitions in a, and both cases of X-partitions, 
follow the same line of reasoning. Note that the sizes of bins to which this bound can be 
applied are limited to Y < X < a*b, because for larger sizes if there is a homogeneous 
perfect partition given hy m * b, then there is another perfect partition, b * a + (m - a) * b. 

We also note that the procedure to rearrange boxes adopted in the proof of Theorem 
IV. 1 only applies to homogeneous partitions that are perfect. When considering other 
homogeneous efficient partitions, there is at least one unit strip that is not covered with a 
box. In this case, the considerations associated with Figure IV.3 do not apply. In Figure 
IV.I, we can see an example of a packing pattern, with homogeneous efficient Y-partitions 
that cannot be rearranged without reducing the number of boxes packed. 

We refer to this bounding procedure as the Single Homogeneous Perfect Partition 
(SHPP) Bound. Although the requirements to apply this bound may seem too restrictive to 
be useful. Table IV.2 shows that more than 50% of the instances with at most 100 boxes, 
not bounded by other elementary procedures, are bounded by this new simple bound. 


Number of 
boxes 

Number of 
Classes 

Classes 
with opeu 
results 
from 

Table IV.l 

Oue-Block 

Two-Block 

Hollow- 

Block 

Five-Block 

Classes 
with opeu 
results 

20 

7,309 

68 

20 

29 

0 

2 

17 

50 

216,095 

6,823 

1,874 

1,823 

0 

371 

2,755 

100 

3,080,730 

156,527 

37,350 

35,808 

0 

7,726 

75,643 


Table IV.2 Number of instances with an open result in Table IV. 1 bounded by the SHPP 
Bound, in each group. 

The first three columns are from Table IV. 1. The next four columns contain the number of 
classes with optimal packing patterns generated by the given heuristic. The last column 
contains the number of classes without a proven optimal solution, after applying the AR 
bound, the MP bound, Barnes ’ bound, the MAR bound and the SHPP bound. 

A different bound, also based on single perfect partitions, and wasted area, can be 

computed, when EW(N,X,Y,a,b)<b or EW{N,X,Y,a,b)<a . In this case, we use some 

results from Nelissen [1995]. 

Nelissen defines Ix^ j as a lower bound on the number of unit rows in any optimal 

solution where boxes in each such unit row correspond to X-partition {i,j), and fyj- ^ as the 

lower bound on the number of unit columns in any optimal solution where boxes in each 
such unit column correspond to Y-partition (f, g). For any optimal solution, he shows if 


68 




X - < a , then the number of H-boxes is a multiple of g, 

X -fyj g<b, then the number of V-boxes is a multiple of/ 

Y - lx. j <a, then the number of V-boxes is a multiple of j, 

Y - Ix^ J <b , then the number of H-boxes is a multiple of i. 

We use this result in Theorem IV.2. 

Theorem IV,2: Let {X',Y',a,b') be an instanee of PLP, with N' = UN{X',Y',a',b'), 
EW{N',X',Y',a',b')<b', and assume that the only perfeet Y-partition is given by 
n*a' + m*b' = Y'. Then the number of H-boxes in the solution is a multiple of m, and the 
number of V-boxes is a multiple of n. 

Proof: Beeause {n, m) is the only perfeet Y-partition and EW(N',X',Y',a',b')<b', there 
are more than X'-b' unit eolumns where boxes in these unit eolumns eorrespond to Y- 
partition (n, m). Otherwise, more than b' unit eolumns, eaeh with at least one unit of 
waste, would be present, and the total waste would be larger than EW{N',X',Y',a',b'). 
Then > X'-b', X'-ly^^^ <b', the number of H-boxes is a multiple of m, and the 

number of V-boxes is a multiple of n, as shown by Nelissen. Q.E.D, 

The same results ean be shown for partitions of X. 

One example of applieation of this bound is the elass of instanee (14, 13, 4, 3). The 
area ratio bound is 15, with 2 units of waste. Beeause £’1^(15,14,13,4,3) = 2<b = 3 , and 
there is only one perfeet X-partition, (2, 2), the number of H-boxes, and V-boxes, is even. 
The bound is redueed to 14, an even number, and the optimum solution is obtained with the 
two-bloek heuristie. We refer to the bound generated by this proeedure as the Single 
Perfect Partition (SPP) Bound. 

Besides the requirements on the number of H-boxes and V-boxes obtained above, 
another eonelusion ean be reaehed regarding the pattern neeessary to paek the boxes, with a 
wasted area that is smaller than b. Beeause of the integrality of the sizes of boxes and 
pallet, there ean be no wasted area at the pallet’s edge, beeause any sueh region would have 
length, or width, at least b, and at least one unit for the other dimension, with an area at 
least b. Therefore, this wasted area must be loeated in the interior of the pallet, and the 
edges of the pallet are eompletely paeked with boxes. 
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Number of 
boxes 

Total 

Number of 
Classes 

Classes 
with opeu 
results 
from 

Table IV.4 

Oue-Block 

Two-Block 

Hollow- 

Block 

Five-Block 

Classes 
with opeu 
results 

20 

7,309 

17 

0 

1 

0 

2 

14 

50 

216,095 

2,755 

0 

20 

1 

28 

2,706 

100 

3,080,730 

75,739 

0 

128 

19 

234 

75,358 


Table IV 3 Number of instances with an open result in Table IV.2 bounded by the SPP 
bound in each group. 

The first three columns are from Table IV. 2. The next four columns contain the number of 
classes with optimal packing pattern generated by the given heuristic. The last column 
contains the number of classes without a proven optimal solution after applying the AR 
bound, the MP bound, Barnes’ bound, the MAR bound, the SHPP bound and the SPP 
bound. 


2. Bounds Based on Relaxed and Restricted Classes 

The concept of equivalence classes is present in several procedures developed to 
solve, or bound, instances of PLP. This previous work exploits the symmetry of the 
relation between instances belonging to the same class. If the relation between the set of 
feasible partitions of two instances is not symmetric, we extend the use of equivalence 
classes by defining relaxed and restricted classes. 

Let {X, Y, a, b) and (Z, W, c, d) be instances of PLP, with set of feasible partitions 
given by F{X,a,b), F{Y,a,b), F{Z,c,d) , and F{W,c,d). If F{X,a,b) cz F{Z,c,d) and 
F{Y,a,b) <z F{W,c,d), we define (Z, W, c, t/) to be a relaxed class of (X, Y, a, b), and 
represent it {Z,W,c,d) {X,Y,a,b), and define {X, Y, a, b) to be a restricted class of (Z, 

W,c,d), {X, Y,a,b)< (Z, W,c,d). 

For example, consider the instances (69, 36, 11, 5) and (56, 29, 9, 4). The only 
difference between the sets of feasible partitions is that (0, 14) e F(56, 9, 4), but (0, 14) ^ 
F(69, 11, 5). In this case, (69,36,11,5)-< (56,29,9,4) . As a result, instance (56, 29, 9, 4) 
can be packed in more ways than instance (69, 36, 11, 5). Figure IV.4 depicts a feasible 
arrangement for instance (56, 29, 9, 4) in (a), and a feasible arrangement for instance (69, 
36, 11,5) in(b). 
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Figure IV. 4 Example ofpacking patterns for restricted and relaxed classes. 

The packing pattern in (a) is feasible for instance (56,29,9,4), but not for instance 
(69,36,11,5); (b) is a feasible packing pattern for both instances. 

Theorem IV.3: Given an instance {X, Y, a, b), with a feasible arrangement of the boxes on 
the pallet, and a second instance (Z, W, c, d), such that (Z,W,c,d) >- (X,Y,a,b), then there 
is a corresponding arrangement of box cxd on pallet ZxW . 

Proof: The proof follows directly from the proof oiLemma 2, in Dowsland [1984], because 
the proof only requires that the feasible partitions of instance {X, Y, a, b) be replicated by 
instance (Z, W, c, d), and this is clearly true, because F{X,a,b) F{Z,c,d) and 
F{Y,a,b)czF{W,c,d). Q.E.D, 

The relation between instances of relaxed and restrict classes is not symmetric, but 
is transitive. Therefore, if (X,Y,a,b) < (Z,W,c,d), and {Z,W,c,d) <{R,S,e,f), then 
{X,Y,a,b)<{R,S,e,f). For example, (69,36,11,5)-< (56,29,9,4). But 

(56,29,9,4)^(43,23,7,3), so (69,36,11,5)^(43,22,7,3). 

Every instance of PEP in a relaxed class is a relaxation to instances in a restricted 
class. As a result, an upper bound on the number of boxes that can be packed in an instance 
in a relaxed class is an upper bound for all its restricted classes. If we are not able to 
compute a tight bound for a given instance, it might be possible to compute a tighter bound 
on an instance in a relaxed class, and apply the bound. 

Theorem IV,4: If (X, Y, a, b) and (Z, W, c, d) are instances of PEP, and if 
(A, T, a,b) < (Z, W,c,d), then N{X, Y, a, b) < N{Z, W,c,d). 

Proof: Suppose it is not true, and N{X, Y, a, b) > N{Z, W, c, d). Then there exist a feasible 
arrangement of a x 6 boxes on the X xY pallet with N{X, Y, a, b) boxes packed. Because 
(Z, W, c, d) belongs to a relaxed class of (A, Y, a, b), by Theorem IV.3, every feasible 
arrangement obtained in (A, Y, a, b) can be replicated in (Z, W, c, d). Therefore, the 
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corresponding arrangement can be produced in (Z, W, c, d), and N{X, Y, a, b) < N{Z, W, c, 
d). This is a contradiction. Q,E,D. 

As an example, UN{26, 19, 7, 3) = 23, when using the previously described bounds. 
But (26,19,7,3)^(18,13,5,2), because (0,9)eF(18,5,2), and t/A(18, 13, 5, 2) = 22, 
obtained with Barnes’ bound within the class. Therefore, the upper bound for instance (26, 
19, 7, 3) can be reduced to 22, and the solution obtained with the five-block heuristic is 
verified to be optimal by this new bound. We refer to the bound computed with this 
procedure as the Relaxed Class (RC) Bound. 

Table IV.4 presents the results of this new bound when applied to the instances 
from Table IV.3 not yet proven optimal by other bounds. While the number of instances 
where this bound is useful is small, when compared with the total number of classes, we 
can see that this bound is tighter than the previous bounds on a large fraction of the classes 
still considered open. 


Number of 
boxes 

Total 

Number of 
Classes 

Classes 
with opeu 
results 
from 

Table IV.5 

Oue-Block 

Two-Block 

Hollow- 

Block 

Five-Block 

Classes 
with opeu 
results 

20 

7,309 

14 

0 

1 

0 

0 

13 

50 

216,095 

2,706 

115 

589 

2 

218 

1,782 

100 

3,080,730 

75,358 

4,298 

16,260 

61 

8,107 

46,632 


Table IV.4 Number of instances with an open result in Table IV. 3 bounded by the RC 
bound in each group. 

The first three columns are from Table IV. 3. The next four columns contain the number of 
classes with optimal packing pattern generated by the given heuristic. The last column 
contains the number of classes without a proven optimal solution after applying the AR 
bound, the MR bound, Barnes ’ bound, the MAR bound, the SHPP bound, the SPP bound, 
and the RC bound. 

One way to identify relaxed classes is by applying Dowsland’s [1984] minimization 
of area ratio technique. When the instance that minimizes the area ratio is located at the 
open boundary of an equivalenee class, then this instance does not belong to that class, 
although we can get arbitrarily close to it. This instance does not belong to the same class 
because its set of feasible partitions is larger, with at least one extra feasible partition. 

In our previous example, the instance (18, 13, 5, 2) is obtained when trying to 
minimize the area ratio for the class of (26, 19, 7, 3). When minimizing the area ratio 
bound in the relaxed class, we verify that this is attained at a non-integral interior point 
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(2^8 + 4, Vs + 4, Vs, 1), with a ratio of 23.31. This area ratio is not small enough to tighten 
the bound, but a solution obtained by sealing, and rounding to integer values, (482, 341, 
141, 50), is bounded by Barnes’ procedure at value 22. 

Another possible result is that another open boundary solution is generated, and the 
procedure is repeated until the bound is tighter, or the solution is an interior point. An 
example of this chain of relaxed classes can be obtained with the instance (54, 30, 11, 5), 
with three relaxed classes being generated before the bound is tightened. The relation 
among these classes is (54,30,11,5)-< (44,24,9,4)-< (34,18,7,3)-< (24,12,9,2). The area 
ratio bound in the last class is 28, while it is 29 in the others. 

As the relaxed classes can be generated based on minimizing the area ratio bound, 
in some cases, the last class generated in the procedure finally has zero wasted area, but 
does not tighten the bound. Because there is no wasted area, every feasible partition used 
when packing the instance in the restricted class must correspond to a perfect partition in 
the relaxed class, or there would be some wasted area. But if only one feasible partition, in 
the length or width, corresponds to a perfect partition in the relaxed class, then the solution 
can be obtained with the two-block heuristic, or it is not feasible. If we apply the two-block 
heuristic and don’t obtain the expected solution, then the bound in the restricted class can 
be reduced by at least one unit. 

This happens, for example, with instance (23, 19, 8, 3). The area ratio bound for 
this instance is 18. When minimizing this bound in the class, we obtain the instance (15, 
12, 5, 2), in the open boundary. Because 15 is a multiple of 5 and 12 is even, we can pack 
it using a homogeneous block with 18 boxes and there is no wasted area. This is the only 
pattern that can be used to pack 18 boxes and it is not feasible for instance (23, 19, 8, 3), as 
it uses the X-partition (3, 0). If there are feasible packing patterns with 18 boxes for 
instance (23, 19, 8, 3), with a different arrangement, then this arrangement could be 
replicated in the relaxed class, so the bound for instance (23, 19, 8, 3) can be reduced to 17. 

3. Bound Based on Similarity of Classes 

The properties of the prior section can sometimes be extended in a way that a class, 
with a similar set of efficient partitions, can be used to calculate a bound for the solution of 
another class. 
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One such situation exists when the MSI of the class has a homogeneous perfect 
partition. As seen previously, if a perfect partition of this type is present in the solution, 
then it can be transferred to the edge of the pallet. In this case, we can solve a problem with 
reduced dimensions for the pallet and add this homogeneous block to generate a solution to 
the original problem. If this homogeneous partition is the only perfect partition, then we 
have a tighter bound. But when there is more than one perfect partition, then the bound 
cannot be used directly. 

Two possible situations can happen; the optimal packing pattern uses the 
homogeneous partition, or not. 

If the homogeneous partition is present in the solution, then there is a solution 
where this partition is located in the right, or top, edge of the pallet, as shown in Theorem 
IV. 1. In this case, we can solve an instance with reduced dimension by dividing the pallet 
into two rectangles. One is perfectly packed with a homogeneous block, and the other is 
packed by some other procedure. 

Otherwise, if the homogeneous partition is not used in the optimal packing pattern, 
then it may be possible for another class to exist in which all efficient partitions, except for 
this homogeneous partition, are feasible. In this case, any pattern produced in the initial 
class, without using this homogeneous partition, can be replicated. But if, in this related 
class, it is shown that such a pattern does not exist, then the same is also true in the initial 
class. 

The larger of the bounds obtained in these two situations is a valid upper bound for 
the class. The instance (37, 30, 8, 3) is an example of the use of this bound. The set of 
perfect Y-partitions contains two partitions; (3, 2) and (0, 10). The best bound for this 
instance, using the methods proposed above, is 46 boxes. If the solution contains a (0, 10) 
partition then A(37,30,8,3) = max{A(37-8*/,30,8,3) + 10*/, / = 1,2,3,4} = 45. If the 
partition (0, 10) is not used, then all other feasible partitions are also feasible to the instance 
(24, 19, 5, 2). But the optimal number of packed boxes for instance (24, 19, 5, 2) is 45, 
using the area ratio bound. Therefore, if the Y-partition (0, 10) is used, the best result is 45. 
If it is not used, the best result is also 45. Then UN(37, 30, 8, 3) = 45. 
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We refer to this bounding proeedure as the Combined Perfect Partition and Relaxed 
Class (CPPRC) Bound. Table IV. 5 presents the results of this new bound when applied to 


the instanees from Table IV.4 not yet proven optimal by other bounds. 


Number of 
boxes 

Total 

Number of 
Classes 

Classes 
with opeu 
results 
from 

Table IV.4 

Oue-Block 

Two-Block 

Hollow- 

Block 

Five-Block 

Classes 
with opeu 
results 

20 

7,309 

13 

0 

0 

0 

1 

12 

50 

216,095 

1,782 

0 

24 

3 

72 

1,683 

100 

3,080,730 

46,632 

0 

289 

21 

770 

45,552 


Table IV 5 Number of instances with an open result in Table IV. 5 bounded by the CPPRC 
bound in each group. 

The first three columns are from Table IV. 5. The next four columns contain the number of 
classes with optimal packing pattern generated by the given heuristic. The last column 
contains the number of classes without a proven optimal solution after applying the AR 
bound, the MP bound, Barnes ’ bound, the MAR bound, the SHPP bound, the SPP bound, 
the RC bound, and the CPPRC bound. 


4, Extensions to the LP Bound 

Even when the identifieation of a relaxed elass does not help direetly in the 
eomputation of a tighter bound, it still ean be used to help obtain better bounds using the 
LP approaeh deseribed in Seetion III of Chapter II. 

Suppose we are eomputing an upper bound on a given instanee, and that this 
instanee has a relaxed elass with smaller dimensions, and less wasted area. We ean use the 
MSI of this relaxed elass when eomputing the LP bound, but only eonsidering partitions 
that are feasible in the original instanee. 

Let (Z, W, c, d) be an instanee of PLP. Let (X,Y,a,b) y (Z,FV,c,d). Then 
eonstraints (11-20) to (11-27) are replaeed by 


11 = 


Z 

(ij) G F(Z,c,d) 


b 


V= Z 

(f,g) G F(W,c,d) O 

Z ^ ’ 

(iJ) G F{Z,c,d) 

(f,g) e F(W,c,d) 


(IV.l) 

(IV.2) 

(IV.3) 

(IV.4) 
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I 

a * / * x^ j 


= 0, 

(IV.5) 

(i,j) e F(Z,c 

,d) 

{f,g) e F(W,c,d) 


I 

b*j^x.j 


= 0, 

(IV.6) 

(i,j) e F(Z,c 

,d) 

(f,g) e F(W,c,d) 



V(i,7) e 

F(Z,c,d), 


(IV.7) 



G F{W,c,d). 


(IV.8) 


The advantage of using this new set of constraints is that the linear relaxation is 
tighter, and thereby may lead to an improved bound. 

Some additional changes are performed in the LP bound procedure described in 
Section III of Chapter II. Nelissen [1995], among other extensions to the LP bound, 
proposes solving a knapsack problem with the wasted area of an optimal solution as the 
capacity of the knapsack, and the wasted area in each unit column, or row, as the weight. 
This idea can be inserted directly in the LP formulation by defining a target optimal wasted 
area. Waste. If this targeted wasted area value cannot be achieved, then the bound can be 
reduced, and another target waste can be defined. Two extra constraints, relative to this 
target waste, are included in the formulation: 

^ {X-{i*a + j*b)) * X,. ^ = Waste , /jy 9^ 

(iJ)GF(Z,c,d) ^ ^ 


X {Y-{f*a + g*b))*y^^=Waste. 


(IV. 10) 


One example of the usefulness of this improved LP bound is observed with instance 
(116, 74, 10, 9), with a best-known upper bound of 95, but the best-known packing 
contains 94 boxes. This is one of the instances reported by Scheithauer [2000] where the 
best-known packing does not attain the best-known upper bound. The instance (68, 42, 6, 
5) is the last class generated in the computation of the relaxed classes using the 
minimization of area ratio bound procedure. When applying the new LP bound, the bound 
is reduced to 94. 


5, Performance of New Bounds 

Table IV. 6 presents the cumulative results displayed previously from Tables IV. 1 to 
Table IV.5. It does not contain complete results for the extended LP bound, because this 
new procedure was applied to a small set of the remaining open problems. 
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Number of 
boxes 

Classes with 
open results 
from Table 
IV.l 

Instances 

Instances 

Instances 

Instances 

bounded with 

bounded with 

bounded with 

bounded with 

SHPP Bound 

SPP Bound 

RC Bound 

CPPRC Bound 

20 

68 

51 

3 

1 

1 

50 

6,823 

4,068 

49 

924 

99 

100 

156,527 

80,788 

381 

28,661 

1,083 


Table IV6 Cumulative results of the SHPP, SPP, RC and CPPRC bounds. 

The first two columns are from Table IV. 1. The values on the SHPP column come from 
Table IV.2. The values on the SPP column come from Table IV. 3. The values on the RC 
column come from Table IV. 4. The values on the CPPRC column come from Table IV. 5. 
These results are obtained when applying the bounds in column order. 

As shown in Table IV.6, more than 70% of the instanees not bounded exaetly by the 
AR Bound, MP Bound, Barnes’ Bound and MAR Bound, are bounded using the new 
bounds proposed in this dissertation. 

Table IV. 7 presents the results of the individual applieation of these bounds on the 
instances with open results from Table IV. 1. These numbers corresponds to instances 
where the mentioned bound is able to tighten the bound (reduce by at least 1 box), even 


when not being exact. 


Number of 
boxes 

Classes with 
open results 
from Table 
IV.l 

Bound tighten 
with SHPP 
procedure 

Bound tighten 
with SPP 
procedure 

Bound tighten 
with RC 
procedure 

Bound tighten 
with CPPRC 
procedure 

20 

68 

52 

3 

52 

56 

50 

6,823 

4,571 

52 

5,032 

5,161 

100 

156,525 

97,186 

463 

111,800 

113,065 


Table IV 7 Results of individually applying the SHPP, SPP, RC and CPPRC bounds. 

The first two columns are from Table IV. I. The next four columns present the number of 
equivalence classes with the bound on the maximum number of boxes packed reduced with 
the application of the respective procedure. 

In order to compare the performance of the new proposed bounds with the results 
obtained by Nelissen [1995] with his extended LP bound, we apply the proposed bounds to 
a set of 187 instances of PLP whose correct bounds are not computed by other methods. 
Nelissen [1995] reported that his procedure is not able to tighten the bound for 36 instances. 
In our case, the best-computed bound is not exact for only six instances. 

Only about 1.5% of the equivalence classes of PLP with at most 100 boxes may 
require a more complex algorithm to deliver the optimal solution, although in some cases it 
may just require a better bounding procedure to confirm the optimality of a known packing 
pattern. 
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D. NEW RECURSIVE HEURISTICS FOR PEP 


In this dissertation, we propose new recursive heuristics to solve PLP. The first 
heuristic, named the G5-heuristic, can be regarded as a combination of the heuristics 
proposed by Nelissen [1993], Scheithauer and Temo [1996], and Morabito and Morales 
[1998]. The second one, named Higher Order Non-Guillotine (HONG) heuristic, solves 
some of the problems encountered when dealing with problems with more than 50 boxes to 
pack. 


1. The G5-Heuristic 

The heuristic proposed by Nelissen [1993] combines a few simple heuristics into a 
recursive heuristic. The number of recursion steps is limited to reduce run time. 

The heuristic proposed by Scheithauer and Temo [1996], the G4-heuristic, 
recursively applies the four-block heuristic. There is no a priori limitation on the number of 
recursive calls, and bounds are used to decide if further searches in the recursion tree are 
necessary. The G4-heuristic does not identify optimal solutions that do not present G4- 
patterns, and unlimited recursion may result in long mn times when solving instances with 
a large number of boxes. 

The heuristic proposed by Morabito and Morales [1998], referred to here as M&M, 
uses the idea of H‘-order cuts, discussed in Section I.E, and the solutions generated present 
H*-order patterns. This heuristic has a larger solution space than the G4-heuristic, and it 
may take longer to enumerate all solutions. 

The G5-heuristic also looks for H*-order patterns, but tries to reduce mn times by 
applying the hollow block heuristic. The hollow block pattern, as shown in Figure IV. 1, is 
a G4-pattern, and also a H‘-order pattern, but can be identified much faster by the hollow 
block heuristic. Another characteristic of the G5-heuristic is that there is only one level of 
recursion. 

There are four main loops in the algorithm, sequentially assigning the dimensions of 
the four blocks in corners of the packing pattern. The fifth, or central, block has its 
dimensions defined by the other blocks as in the five-block heuristic. Each of these five 
blocks has a packing pattern computed using the hollow block, one-, two-, and five-block 
heuristics, or the G5-heuristic, but with no additional recursive call. 
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The wasted area within each block is also computed. At each step of the algorithm, 
after defining the dimensions of a block, the cumulative sum of wasted areas is computed, 
preventing the exploration of patterns producing too much waste. 

In order to avoid looking at symmetric patterns, the block with the most boxes 
packed, with the exception of the central block, is defined to be the first block at the lower 
left corner. Whenever a pattern is produced with another block having a larger number of 
boxes, the execution of the algorithm moves to the next pattern. This is a different strategy 
from the G4 and M&M heuristics. 

As implemented in the G4-heuristic, we keep track of all partial patterns produced. 
Therefore, the solution to the packing problem of a block with given dimensions is stored 
when it is first computed, and is used again whenever a block with the same dimensions is 
encountered later in the procedure. 

Morabito and Morales [1998] present the computation results obtained with their 
heuristic to selected instances from the literature, with run times recorded on a Pentium 100 
MHz personal computer. Scheithauer has an implementation of the G4-heuristic available 
for download from the Internet [CADAP 2002]. We run both G4 and G5 heuristics, on the 
same set of problems, on a Pentium 133 MHz personal computer, so the run times could be 
compared with those reported by Morabito and Morales (Table IV. 7). As described by 
Morabito and Morales, problems D1 and D2 are from Dowsland [1984], N1 to N5 from 


Nelissen [1994], and STl to ST5 from Scheithauer and Terno [1996]. 


ID 

Instance 

MSI 

N 

Rnn Time (Sec) 

M&M 

G4 

G5 

D1 

(22,16, 5, 3) 

(22, 16, 5, 3) 

23 

0.10 

0.00 

0.00 

D2 

(86, 82, 15, 11) 

(23,22,4, 3) 

42 

0.50 

0.05 

0.06 

N1 

(43, 26, 7, 3) 

(43, 26, 7, 3) 

52* 

1.60 

0.06 

0.50 

N2 

(87, 47, 7, 6) 

(87, 47, 7, 6) 

97 

46.30 

1.21 

2.42 

N3 

(153, 100, 24, 7) 

(109, 71, 17, 5) 

90 

0.10 

1.21 

0.01 

N4 

(42, 39, 9, 4) 

(42, 39, 9, 4) 

45 

2.00 

0.11 

0.25 

N5 

(124,81,21, 10) 

(64,41,11,5) 

47 

5.50 

0.16 

0.11 

STl 

(40, 25, 7, 3) 

(40, 25, 7, 3) 

47 

2.10 

0.11 

0.19 

ST2 

(52, 33, 9, 4) 

(52, 33, 9, 4) 

47 

3.10 

0.11 

0.19 

ST3 

(57, 44, 12, 5) 

(57, 44, 12, 5) 

41 

0.90 

0.11 

0.13 

ST4 

(56, 52, 12, 5) 

(56, 52, 12, 5) 

48 

2.20 

0.11 

0.21 

STS 

(300, 200,21, 19) 

(127, 85, 9, 8) 

149 

0.10 

9.23 

0.01 


Table IV 8 Run times obtained with three dijferent heuristics, when solving a selected set of 
problems from the literature. 

* Indicates that the solution is not optimal. 
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The G5-heuristic is slower than the G4-heuristic, and faster than the M&M heuristie 
in almost all instances. 

Scheithauer [2000] provided a list with 206 instances, from a larger set called Cover 
//by Nelissen [1993], containing instances satisfying constraints (11.28), (11.29), and (11.31). 
These 206 instances are not solved to optimality by Nelissen’s heuristic. Scheithauer 
[2000] reports that the G4-heuristic is able to solve 167 of these instances. The G5- 
heuristic is able to solve the same 167 instances, and solves two additional instances, (121, 
120, 16, 9), and (107, 65, 10, 7). These two instances have solutions with l®*-order patterns 
that are not G4-patterns. On instances in which both heuristics find the optimal solution, 
the G4-heuristic is faster than the G5-heuristic. 


Table IV. 9 presents the number of instances not previously solved with the simple 
heuristics mentioned in Section C with a proven optimal solution obtained with the G5- 
heuristic. 


Number of boxes 

Total Number of 
Classes 

Classes with Opeu 
Results from Table 
IV.6 

Solved with G5- 
Heuristic 

Classes with opeu 
results 

20 

7,309 

12 

10 

2 

50 

216,095 

1,683 

1,449 

234 

100 

3,080,730 

45,552 

38,546 

7,006 


Table IV 9 Number of instances from table IV 6 without a previously proven optimal 
solution, solved using the G5-heuristic. 

The first three columns are from Table IV. 6. The next column contains the number of 
classes with optimal packing pattern generated by the G5-heuristic. The last column 
contains the number of classes without a proven optimal solution after applying the AR 
bound, the MP bound, Barnes ’ bound, the MAR Bound, the SHPP bound, the SPP bound, 
the RC bound, and the CPPRC bound. 

Another important result is that the difference between the solution generated by the 
G5-heuristic and the best possible solution, as defined by the available upper bounds, is at 
most one box for all problems. As it is shown in the next section, with the application of an 
exact algorithm, the G5-heuristic generates optimal solutions to all instances of PLP with 
AR bound up to 51 boxes, and approximately 99.999% of all instances with AR bound of 
up to 100 boxes, differing at by one box in the 0.001% (60 classes) remaining instances. 
Therefore, using a procedure exploring non l®*-order patterns can improve the solution by at 
most one box. 
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2. Higher Order Non-Guillotine Heuristics 

As the number of boxes that ean be paeked inereases, so does the variety of the 
optimal patterns. Morabito and Morales [1998] present a non l®*-order pattern solution to 
instanee (43, 26, 7, 3), obtained using a MIP model of PLP and solved using GAMS 2.50 
[GAMS 2000] with the OSL 2 solver [IBM 2000]. They report that the solver needed more 
than 30 minutes, on a Pentium 100 MHz personal eomputer, to find the optimal solution, 
shown in Figure IV.5. The borders of each block are reinforced so it is easier to observe 
that there are 8 blocks, and that these blocks do not form a H*-order pattern. This is one of 
the instances not solved by the G5-heuristic in the COVER II set. 



Figure IV.5 Non f'-order pattern solution for the class of instance (43, 26, 7, 3). 

The Higher-Order Non-Guillotine {HONG) heuristics have been developed, 
initially, to verify if other instances in the same set present the same type of arrangement. 
They work by dividing the pallet in at most eight blocks, distributed as shown in Figure 
IV.6. As can be seen, all three patterns are not Hkorder. The pattern in Figure IV.6 (a) is a 
vertical pattern, because it is possible to draw a vertical line crossing four blocks. A 
horizontal pattern, where a horizontal line crosses four blocks, is shown in (b). The last 
pattern, (c), is named a central pattern. 

The implementation of the HONG heuristics is an extension of the G5-heuristic, but 
has up to five additional loops, for a total of nine nested loops. Each of these eight blocks 
can be packed using the non-recursive G5-heuristic. We implemented the three versions of 
the heuristic. We are not able to identify any characteristics of an instance indicating which 
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version is the best one to apply in eaeh case, and because of the relatively (when compared 
with the G5-heuristic) long run times associated with each version of the algorithm, we 
propose to execute all versions in parallel, halting when a solution is obtained by one of the 
three versions. 



Figure IV 6 Non F'-order patterns explored by the HONG heuristic. 

The pattern in (a) is a vertical pattern; (b) shows a horizontal pattern; and (c) is a central 
pattern. 

Table IV. 9 lists the instances of the COVER II set, not previously solved by other 
heuristics, which are solved using the HONG heuristics. The run times shown correspond 
to the time required by a Pentium III 600 MHz computer, using the version of the heuristic 
(vertical or horizontal) that obtains the optimal solution for each instance. If all versions 
are used in parallel, we should observe computational effort roughly three times the values 
listed. 
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Instance 

Nnmber of 

Boxes 

Rnn Time 

(Sec) 

(76,74,13,5) 

86 

345.54 

(106,100,16,7) 

94 

11.26 

(83,82,11,7) 

88 

3.48 

(104,69,12,7) 

85 

2.10 

(103,86,11,8) 

100 

15.05 

(104,71,11,7) 

95 

20.47 

(75,51,8,5) 

95 

6.91 

(108,71,11,7) 

99 

10.61 

(78,51,8,5) 

99 

4.54 

(61,38,6,5) 

77 

0.86 

(108,65,10,7) 

100 

2.44 

(164,83,14,11) 

88 

3.38 

(105,53,9,7) 

88 

2.83 

(57, 34, 7, 4) 

69 

1.70 

(122, 86, 16, 7) 

93 

1.97 





Instance 

Nnmber of 

Boxes 

Rnn Time 

(Sec) 

(43,26,7,3) 

53 

0.50 

(49,28,8,3) 

57 

0.99 

(61,35,10,3) 

71 

2.63 

(61,38,10,3) 

77 

3.66 

(67,37,11,3) 

75 

3.36 

(67,40,11,3) 

81 

7.51 

(141,119,21,8) 

99 

88.17 

(93,46,13,4) 

82 

15.26 

(63,44,8,5) 

69 

3.80 

(57,34,7,4) 

69 

2.64 

(106,59,13,5) 

96 

17.84 

(141,71,13,8) 

96 

18.13 

(74,73,13,5) 

82 

30.45 

(74, 49, 11,4) 

82 

0.28 

(127, 121,23,7) 

95 

1.20 

(106,59, 13,5) 

96 

8.68 


Table IV. 10 Instances of the set COVER II solved to optimality by the HONG heuristics. 
Run times correspond to the time required by the version of the algorithm (vertical, 
horizontal, or central) that obtains the optimal solution faster (in some cases, more than 
one version generates an optimal packing pattern). 

In addition to instances in Table IV.9, the HONG heuristie is able to solve to 
optimality other instanees not ineluded in the COVER II set [Nelissen 1993]. Table IV.IO 
presents the results of the applieation of the HONG heuristie to the instanees with open 
results after the using the G5 heuristie, from Table IV.IO. 


Nnmber of boxes 

Total Nnmber 
of Classes 

Classes with Open 
Resnlts from Table IV.8 

Solved by 
HONG 
Henristic 

Classes with open 
resnlts 

20 

7,309 

2 

0 

2 

50 

216,095 

234 

0 

234 

100 

3,080,730 

7,006 

54 

6,952 


Table IV.ll Number of instances, from table IV.8, without a proven optimal solution, 
solved using the HONG heuristics. 
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E. A NEW EXACT ALGORITHM FOR PEP - THE HVZ ALGORITHM 


Even with the development of new bounds and new heuristics, not all instances 
have a proven optimal solution given by a heuristic. In some situations it still might be 
desirable to find the optimal solution, even if it might require the extra run time of an exact 
algorithm. In order to solve, or verify optimality of, these remaining problems, we 
developed a new exact algorithm. 

We initially explore different ways to represent a packing pattern, considering the 
possibility of coding the packing pattern of N boxes on a binary string with length N. A 
coordinate system with origin at the lower left corner of the pallet is used, with the left 
lower comer of box i , when packed in the pallet, represented by In the coding, an 

H-box is represented by the letter H, and a V-box by the letter V. Each box is packed in the 
feasible position that yields the minimum sum of coordinates, i.e., x- + y. . In case of ties, 

the position minimizing y. is selected. A position is feasible if the box does not overlap 
with another box packed previously, and is completely packed within the pallet. 

Eigure IV.7 presents a feasible packing for instance (27, 18, 7, 4), with 16 boxes. 
The corresponding string is HVHVVVHVVVVVVHVH. 



Figure IV. 7 Feasible packing pattern for instance (27, 18, 7, 4). 

The pattern can be represented by the binary string HVHVVVHVVVVVVHVH, with H 
indicating an H-box and V a V-box. 
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If every paeking pattern eould be uniquely represented this way, we could use the 
coding scheme to create an algorithm with complexity 0(2^) for verifying the feasibility 
of packing boxes in an instance of PLP. Although still exponential, this algorithm would 
be much faster than a general algorithm for 2D-KP, like the one proposed by Murata et al 
[1995]. Using the bounds on the number of V-boxes and H-boxes obtained using the LP 
bound, we could reduce this complexity even further. 


Figure IV. 8 Feasible packing pattern for instance (7, 7, 5, 2). 

This packing pattern cannot be represented with the binary coding scheme. 

Unfortunately, there are feasible packing patterns that cannot be represented by this 
coding scheme. A simple example is observed in instance (7, 7, 5, 2), and the packing 
pattern depicted in Figure IV. 8. The corresponding string would be HVVH, but when 
trying to pack the third box, the procedure would place it at position (2, 2), not at position 

(5, 0). 

To deal with this situation, we modify our coding scheme to include Z, for zero, 
representing the position of the left lower corner of a wasted rectangular area. In the 
example above, the packing pattern is now coded by HVZVH. The Z label occupies the 
position (2, 2). The next available position is (5, 0), where the next V-box is packed. The 
only position left to pack an H-box is (2, 5). 
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The wasted reetangle has length and width at least one unit long, but may have 
larger dimensions, depending on the use of normal paeking patterns. In this ease, the 
wasted area covers the region up to the next positions that could be used to place a box in a 
normal packing pattern, i.e., positions with the coordinates corresponding to integral 
combinations of a and b. In the example, the wasted area has dimensions 2x2, because 
positions (3, 2), (2, 3) and (3, 3) cannot be obtained as a combination of 5 and 2. 

As the amount of wasted area is registered whenever a Z label is included in the 
string, we can use this coding idea in a depth-first search, fathoming the branches of the 
search tree presenting too much wasted area. 

1. Implementation of HVZ Algorithm 

The HVZ Algorithm is an implementation of depth-first search mentioned above. 
Each node of the search tree corresponds to visiting the point with minimum sum of 
coordinate values. The algorithm selects between placing a box, H-box or V-box, or 
marking the region as wasted. If a box is placed, then all coordinate points covered by the 
box are labeled as used. If marked as wasted, only one coordinate point is labeled, and the 
area of the wasted region is added to the total wasted area, TW. The next node to be 
examined corresponds to the next unlabeled coordinate point. If, at any given step of the 
algorithm, the maximum allowed amount of wasted area, MW, is surpassed {TW > MW) , 
then the algorithm backtracks. The algorithm terminates if a feasible packing of A boxes is 
obtained, or if all possible labels are explored. 

The set of coordinate points is defined in the initialization the algorithm, and 
corresponds to the cartesian product of the sets of feasible partitions of the length and 
width. In our implementation of the HVZ algorithm, we use two arrays to represent these 
coordinate points; 

• A two-dimensional array, with the first dimension corresponding to feasible 
partitions of the length, and the second to feasible partitions of the width. This 
array is used when labeling the coordinate point covered by a box; and 

• A one-dimensional array, with pointers to the coordinate points, sorted by sum 
of coordinate values, and ties solved by smaller width. This array is used to 
identify the next unmarked point. 
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After some experimentation with the HVZ algorithm, we identified some strategies, 
performed at each node, that can yield to shorter run times: 

• If the number of boxes loaded is less than [A^/2j, and the total wasted area is 

already larger than half of the maximum allowed, TW>MWl2, then the 
algorithm backtracks. This is possible because of the symmetry of the packing 
patterns. In this case, the complement of the packing pattern contains at least 
N/2 boxes and at most MW/2 wasted area, and can be obtained at a later step 
of the algorithm. 

• After placing a box, verify that there is enough space between the box and the 
borders of the pallet to pack another box. If not, the region is marked as wasted. 

• If the optimal packing pattern is formed with smaller blocks packed together, 
and if each of these blocks can be packed in different ways, then we have 
several similar, or equivalent, solutions. In order to avoid searching for 
solutions on patterns similar to others already identified as not optimal, we 
verify if the box being packed completes a block. If this is the case, we verify if 
a block with the same dimensions was investigated before, and if the 
arrangement of this block is the same. If it is not, we backtrack. 

2. Results Obtained with the Algorithm 

As an empirical performance comparison, we apply the HVZ algorithm to the same 
instances listed in Table IV.8, and run times are in Table IV. 11, also obtained with a 
Pentium 133 MHz computer. The run times obtained with the G5-heuristic are also 
included. When the run time exceeded 60 minutes, we stopped the execution of the 
algorithm. This situation is identified with a dash in the table. 
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ID 

Instance 

MSI 

N 

Rnn Time (Sec) 

G5-Henristic 

Exact 

Algorithm 

D1 

(22,16, 5, 3) 

(22, 16, 5, 3) 

23 

0.00 

0.0 

D2 

(86, 82, 15, 11) 

(23, 22, 4, 3) 

42 

0.06 

0.0 

N1 

(43, 26, 7, 3) 

(43, 26, 7, 3) 

53 

0.50 

1.2 

N2 

(87, 47, 7, 6) 

(87, 47, 7, 6) 

97 

2.42 

- 

N3 

(153, 100, 24, 7) 

(109, 71, 17, 5) 

90 

0.00 

0.2 

N4 

(42, 39, 9, 4) 

(42, 39, 9, 4) 

45 

0.25 

2.0 

N5 

(124,81,21, 10) 

(64,41, 11,5) 

47 

0.11 

8.0 

STl 

(40, 25, 7, 3) 

(40, 25, 7, 3) 

47 

0.19 

1.1 

ST2 

(52, 33, 9, 4) 

(52, 33, 9, 4) 

47 

0.19 

3.4 

ST3 

(57, 44, 12, 5) 

(57, 44, 12, 5) 

41 

0.13 

0.8 

ST4 

(56, 52, 12, 5) 

(56, 52, 12, 5) 

48 

0.21 

15.0 

STS 

(300, 200,21, 19) 

(127, 85, 9, 8) 

149 

0.00 

- 


Table IV. 12 Run times obtained with the HVZ algorithm and the G5-heuristic for selected 
problems in the literature. 

A dash (-) indicates instances without a computed optimal solution within 60 minutes. 

This new exact algorithm is able to obtain solutions to three additional instances 
from the COVER II set. These instances, shown in Figure IV.9 are (86, 52, 9, 5), (95, 92, 
11,8), and (74, 46, 7, 5). 
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Figure IV 9 Optimal packing patterns obtained using the HVZ algorithm, for instances 
(86,52,9,5), (95, 92, 11, 8), and (74,46,7,5). 

These are non f border patterns. 
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3. Complexity of the HVZ Algorithm 

As discussed in the beginning of this seetion, using a HVZ string to eode any 
paeking pattern requires at most N + W eharaeters, where N is the number of boxes paeked 
and W is the wasted area in the optimal packing pattern. Eaeh of the N eharaeters 
corresponding to paeked boxes can take two different values, with 2^ ways to assign these 
values. If W eharaeters are neeessary to represent wasted areas, then there are ways 

of seleeting the position of these eharaeters in the string. 

It takes 0{{N + WY) to verify if the pattern eoded by a given string is feasible. As 
the number of items paeked and amount of wasted area gets larger, the eomputational effort 
inereases exponentially. 

F. A NOT SO EXACT ALGORITHM 

Bhattaeharya et al [1998] propose an algorithm, PalDepth, for PLP, using a new 
coneept they called Maximal Breadth Filling Sequence (MBPS). This new concept, based 
on the idea of effieient partitions, solves PLP by sequentially filling the pallet with boxes 
forming an efficient partition of the remaining region. The main characteristic is that a 
partition is always packed with all V-boxes plaeed after any H-boxes. Different packing 
strategies are organized in a tree-like strueture, and tested depth-first. They show that the 
algorithm outperforms others in the literature. 

When packing the partition {n, m) in the pallet, there can be ^ ways of ordering 

the V-boxes and H-boxes. If only one ordering, with m V-boxes after n H-boxes, is used, 
then there is a substantial reduetion in the solution space. An algorithm exploring this idea 
ean be mueh faster than others. To justify this approaeh, the authors present their proof of 
the validity of only eonsidering this ordering. Their proof is based on showing that any 
optimal pattern ean be eonverted into a pattern generated by the PalDepth algorithm. But 
their proof is not correct, and it is possible to find optimal solutions to PLP that eannot be 
generated by their algorithm. 

We present a eounterexample. In Lemma I, Bhattaeharya et al [1998] elaim that 
given any optimal arrangement for an instanee of a PLP, it can be eonverted to an 
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arrangement in which the top row contains all V-boxes to the left of all H-boxes. The proof 
states that a sequential rearrangement of the boxes produces an alternate optimal solution 
with the necessary arrangement. 

In Figure IV. 10, we perform the steps established in their constructive proof, until it 
is not possible to follow it further, and an optimal solution is not obtained. Figure IV. 10 (a) 
shows an optimal arrangement for the instance (43, 26, 7, 3). The first step is to reorganize 
the top row so that the V-boxes are to the left of the H-boxes, as shown in (b). The process 
is repeated, as required, for the next rows of boxes, in (c) and (d). But in (d), it is possible 
to observe that the wasted area is already larger than in the optimal solution. When trying 
the next step, in (e), we verify that it is not possible to pack the next row of V-pieces. Of 
course, this transformation could be performed by rotating the pallet vertically, but this step 
is not considered in their proof. Also, even after this rotation, the PalDepth algorithm 
cannot produce the resulting packing pattern. 

Although Lemma 1 is not true and is used by Bhattacharya et al [1998] to prove the 
correctness of the PalDepth algorithm, we still haven’t shown that their algorithm isn’t 
correct. Using our HVZ algorithm, with the search reduction strategies disabled, we 
generate all possible optimal arrangements for instance (43, 26, 7, 3). We obtained 12 
different solutions, corresponding to rotations and reflections of the whole pallet, and the 
central hollow block, and none of these could have been achieved with the PalDepth 
algorithm. 
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Figure IV. 10 Steps using the procedure proposed by Bhattacharya et al [1998]. 

The objective is to convert an optimal pattern for instance (43, 26, 7, 3) into another 
optimal pattern with all V-boxes in the top row placed to the left of all H-boxes. 
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V. THE MULTIDIMENSIONAL KNAPSACK PROBLEM 


This chapter surveys MD-KP literature with emphasis on exact algorithms accepting 
non-guillotine cut patterns. It also contains the analysis of a MIP model for 2D-KP, 
focusing on identifying some of the aspeets of model building that affeets computational 
performance. 

A, LITERATURE ON SOLVING MD-KP 

In this Seetion, we review existing heuristies, approximation algorithms, and exaet 
algorithm for MD-KP. 

1. Heuristics and Approximation Algorithms for MD-KP 

Moon and Moser [1967], among other results, present upper bounds on the area S of 
a two-dimensional bin necessary to pack a list / of items. This upper bound is based only 
on the total area of the items, = , and the largest side among all items, 

iEl 

D = max{/p wj. If all items in the list are squares, then the list ean be paeked in any square 

iel 

bin with side B,B > D + ^A-. The list ean also be packed in any reetangular bin with 
S > 2 A, and shorter side B, '\i D < B. If items and bin are rectangular, it is shown that the 
items can be packed in a bin with shorter side B, with D < 5, if 5* > 2^4 -l- B^ jl. 

The proof, in all cases, is constructive, and is based on a packing algorithm. The 
algorithm initially sorts items from largest to smallest, and then packs the items in layers, as 
in shelves, with the height of each layer defined by the largest item in it. Each item is 
always placed in the lowest, and leftmost, position that accepts the item, without violating 
the borders of the bin. Therefore, the algorithm fixes the order in which items are paeked, 
defines where to paek eaeh item, fixes the orientation, and generates only guillotine eut 
patterns. Figure V.l presents a typical layout obtained with this approaeh. 
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Figure V.l Typical packing pattern obtained with the packing algorithm described by 
Moon and Moser [1967]. 

Meir and Moser [1968], using a variation of the same algorithm, improve the upper 
bound on the area of the bin in the general ease, with reetangular items and bins, and show 
that if 5* > 2^4 + 5^/8, then the set of items can be packed. 

George and Robinson [1980] also explore the idea of using layers of items when 
packing three-dimensional boxes in a container. As in the work of Meir and Moser [1967], 
items are sorted by size and packed in layers on the length of container. The length of each 
layer is the length of the first item packed in it. If an empty space is encountered between 
layers, then a filling scheme is employed in this space. Whenever possible, boxes of same 
dimensions are packed together. The authors report good practical results, although the 
worst-case performance is not analyzed. 

The algorithm proposed by Coffman et al [1980], First-Fit Decreasing-Height 
(FFDH), for 2D-SPP generates patterns similar to those produced by Moon and Moser 
[1967] and George and Robinson [1980]. In this case, the dimensions considered by the 
authors for the bin are width and height. The width of the bin is fixed and the objective is 
to minimize the height of packing all items. This algorithm obtains heights that are at most 
1.7 times larger than the height observed in an optimal solution. 

Wang [1983] presents a method for generating solutions for 2D-KP based on the 
idea of combining items together into larger rectangles and combining these again into 
larger rectangles, and solves instances with up to 20 items. Further work with this 
approach includes Oliveira and Ferreira [1990] and Daza et al [1995]. 

Murata et al [1995] introduce the idea of Sequence Pairs, and show that it can be 
used to represent and solve 2D-KP problems. A Sequence Pair representation of the 
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packing pattern of a set / = {a,b,c,d,...} of items eonsists of two strings, eaeh with length 


/ , determined on an oblique grid as shown in Figure V.2. 



Figure V.2 Using Sequence Pairs to represent a packing pattern for 2D-KP. 

The packing pattern in (a), with items {a, b, c, d, e,f} is represented by the sequence pair (a 
bdecfcbfade). The order of the symbols in the string determines the position of the 
item in the oblique grid, and defines the packing pattern (after Kang and Dai [1998]). 

Considering 3D-KP, Li and Cheng [1990] demonstrate that packing strategies as the 
FFDH have unbounded worst-case performance bounds in 3D-SPP and propose a new 
approximation algorithm which generates paeking with height at most 3.25 times larger 
than in an optimal solution. Li and Cheng [1992] subsequently study other approximation 
algorithms. 

Chen et al [1995] propose an exaet algorithm for eontainer loading based on a MIP 
model, and show it can be used to solve an instance of 3D-KP with six items. 

Scheithauer and Sommerweiss [1998] propose another approach for 2D-KP, not 
based on layers. Their procedure, the Four-Block heuristic based on the G4-heuristic for 
PLP [Seheithauer and Temo 1996], packs items with identical dimensions in bloeks, and 
uses up to four bloeks placed in the comers of the bin. Eaeh block is composed with 
different items, as in Figure V.3. 
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Figure V.3 Packing pattern generated with the 4-Block heuristic, proposed by Scheithauer 
and Sommerweiss [1998], 

Scheithauer and Sommerweiss [1998] also diseuss some praetieal eonditions 
influeneing the feasibility of paeking patterns. These eonditions, usually observed in real 
world applications, are; 

Weight: The total weight of the items packed in a pallet has to be less than a 
struetural limit. 

Placement: Some items, beeause of their density, weight, or eontents may not be 
plaeed on top of other items. 

Splitting: If the demand of a given item is large enough to oeeupy a single pallet, 
then a pallet paeked only with this item has to be used. This restrietion has the 
objeet of reducing loading costs. This may also apply to a full layer of the same 
produet on a pallet. 

Connectivity: All items of a given type are to be paeked as a block in a pallet. This 
reduces the number of trips the loader must perform to the storage area. 

Stability: Paeking patterns have to be stable for transport. 

Bisehoff and Rateliff [1995] and Adams [1996] address these and other eonditions 
related to eontainer loading. 
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2. Exact Algorithms for 2D-KP 

Gilmore and Gomory [1965], while studying solutions for MD-BPP, are the first to 
propose an algorithm for solving MD-KP. Noting that “there is no efficient method for 
solving the generalized knapsack problem of the higher dimensional problem”, they 
concentrate their effort on the version of the problem with two-stage guillotine cutting; the 
stock rectangle is first slit down its length into strips, and then each individual strip is cut 
across its width. A third trimming stage is used, if necessary. The orientation of the items 
is fixed, with no rotations allowed. 

Figure V.4 shows the generation sequence of a two-stage guillotine-cutting pattern, 
with a third trimming stage. 

If the application of the two-stage guillotine pattern and fixed orientation 
restrictions are not dictated by operational conditions, as may be the case in the lumber 
industry [Gilmore and Gomory 1965], solutions obtained with this approach may “differ” 
from an optimal solution produced without these restrictions by as much as 100%, as 
shown in Chapter 1, Section E. 

Barnett and Kynch [1967] show that if two types of items are to be packed, both 
with unit width and relatively prime lengths, and if the bin is large enough, then there is a 
packing pattern with zero wasted area. 
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Figure V.4 Two-stage guillotine cutting pattern studied by Gilmore and Gomory [1965]. 

(a) The stock rectangle is first slit down its length into strips, and (b) then each individual 
strip is cut across its width. A third trimming stage (c) is used, if necessary. 

Beasley [1985b] proposes the first exaet algorithm for the non-guillotine eutting 

version of 2D-KP. He formulates the problem as an integer linear program. In his 

formulation, a large stoek reetangle (bin) with sizes X x 7 is to be eut into a set / of 

different types of items, with pieee i {i e T) having dimensions /. x w., value v,-, and a range, 

(pi, q] for the number of eopies paeked. The objeetive is to maximize the total value of the 
pieees eut. Normal cutting patterns are used. 

m 

Let L = {0 < r < X I r = = 0,...,^., / G /} be the set of possible cut positions 

i=\ 

m 

in the length, and W = {0<s<Y\s = = 0,...,^,, V/ e /} be the set of out positions 

i=l 

in the width - the use of normal eutting pattern restriots out positions to linear oombinations 
of the length and width of the items. The ordered pair (r, s), or {t, u), where r e L, s eW, 
t e L, u eW, indioates a possible eutting point in the stoek. The dimensions of stoek 
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rectangle and items are only used in a pre-process phase, to compute the data used in the 
model. A model formulation follows. 

Indices: 

i Type of items to cut, z e / . 

r, t Cut position in the length, r ^ L,t ^ L . 

s, u Cut position in the width, s ,u . 

Data: 

1 if piece type z, when cut with its bottom left corner at the point (r, s). 
cuts out the point {t,u) and 0 otherwise. 

p. Lower bound on the number of items type z. 

q. Upper bound on the number of items type z. 

V. Value of item type z. 

Variables: 

1 if a piece of type z is cut with its bottom left corner at (r, s) and 0 
otherwise. 

Formulation: 

te/ tgL sgW 

subject to 


Z Z Z <iyteL,ueW , 

(V.l) 

iel reL sefV 


(V.2) 

r^L seW 

e{0,l},Vze/,VreL,V5eIf. 

(V.3) 


Constraints (V.l) guarantee that only one item occupies any given region inside the 
bin. Constraints (V.2) enforce lower and upper bounds on number of copies of each item. 
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Using a lagrangean relaxation of this formulation to provide upper bounds, and a 
speeialized branch-and-bound seareh, Beasley [1985b] solves problems with up to 22 items 
of 10 different types. 

Hadjieonstantinou and Christofides [1995] revisit Beasley’s work, and propose a 
new integer linear program for 2D-KP; 

Indiees: 

i Type of items to be paeked, z e /. 
j Order of item of type i. 
r Cut position in the length, r e L . 

s Cut position in the width, s eJV . 

t Position of the left limit of an unused region, t = Q,...,X-\. 

u Position of the lower limit of an unused region, w = 0,..., T -1. 

Data: 

/. Length of item type i. 

Wj Width of item type i. 

p. Lower bound on the number of items type i. 

q. Upper bound on the number of items type i. 

Vi Value of item type i. 

Variables: 

x-j^ 1 if the copy, y = 1 ,...,^. , of item i is eut with its bottom left eorner 
at position r ^ L and 0 otherwise. 

1 if the copy, j = 1,..., q ^, of item i is eut with its bottom left eorner at 
position s e fV and 0 otherwise. 

1 if point (t,u),t = 0,...,X-l,u = 0,...,Y-1 has not been cut out by any 
item z and 0 otherwise. 
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Formulation; 


/e/ j=\ reL 

subject to 


5+w,--l r+/,-l 


u=s t=r 

(V.5) 

<l,V/e 7,7 = 1,...,^., 

reL 

(V.6) 

reL sefV 

(V.7) 

iel j=\ r=t-lj-\-\,reL w=0 

(V.8) 

iel j=\ 5=w-Wj+l,5GW /=0 

(V.9) 

= \,...,q^,yr eL,yseW, 

(V.IO) 

e{0,l},t = 0,...,X-l,M = 0,...,T-1. 

(V.ll) 


Constraints (V.5) set the value of z^„to zero if (t,u) is inside a region occupied by 

an item. Because of constraints (V.6) and (V.7), each item can be packed at most once in 
the bin. Constraints (V.8) and (V.9) limit the number of items that can be packed at the 
same length (V.8) and width (V.9). This formulation does not require the pre-processing 
phase adopted in Beasley [1985b] and uses a different number of binary variables. 

Hadjiconstantinou and Christofides also employ lagrangean relaxation in this model 
as a bounding procedure within a specialized branch-and-bound algorithm, and solve 
problems about the same size as those solved by Beasley [1985b]. 

At each branching decision of the algorithm, a partial packing pattern is defined 
using a placement rule named left-most downward placement. According to this rule, each 
item is packed at a position “which firstly minimizes the x-coordinate of the placement [...] 
and secondly [...] minimizes the y-coordinate of the placement.” A feasible placement 
location is a location where the item cannot be pushed downward and leftward, 
corresponding to a normal pattern. Their procedure tries packing each item in all feasible 
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placement loeations. Figure V.5 shows admissible placement loeations at a possible stage 
of the branch-and-bound seareh. 



1 






2 






3 



4 


Figure V.5 Admissible placement locations according to the ‘left-most downward 
placement’ rule. 

The next item to be cut (or packed) is positioned in accordance with the rule: first minimize 
the x-coordinate and then the y-coordinate. 

One of the major problems with this rule, as mentioned by the authors, is that 
different paeking sequences can lead to the same paeking pattern. 

In both approaehes deseribed above, binary variables are related to both the number 
of items and dimensions of the bin (stoek pieee). The number of binary variables in each 
model increases with |/| * \l\ * \w\. 

Martello et al [2000] propose a procedure similar to the one proposed by 
Christofides and Hadjieonstantinou to enumerate patterns for paeking individual bins in 
3D-BPP. They develop an algorithm, ONEBIN, for testing if a given assignment of items 
to a bin is feasible. 

B, A MIP FORMULATION FOR 2D-KP 

In this seetion, we study a MIP formulation for 2D-KP, with the objeetive of better 
understanding the effect of using integer and binary variables to represent the relations 
involved. 

One of the main difficulties in formulating this family of problems is representing 
the physieal constraint that no two items share the same region in space. Previous works 
add an additional eonstraint of guillotine cuts, or use a discrete grid to represent the 
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possible packing positions. In most cases, as in Beasley [1985b] and Hadjiconstantinou 
and Christofides [1995], no rotation is allowed. 

The work of Chen et al [1995], proposing a MIP for 3D-BPP, allows rotation, but 
the objective of the authors is to present “an analytical model to capture the mathematical 
essence of the problem.” They also conclude “a more efficient solution procedure is needed 
to solve large scale [...] problems.” They solve an instance of 3D-KP with 6 items, but do 
not elaborate on the application of the algorithm for 2D-KP. 

We implement a similar model for 2D-KP, and use this model to study the effect of 
some modeling techniques on computational performance. We use, as in Chen et al [1995], 
the relative position between items to handle the non-overlapping constraints. 

Let e / , denote the horizontal (vertical) position of the left (lower) side of 

the item inside the bin, with the origin at the left lower corner of the bin. In our model, we 
allow 90° rotations. 

1. Indicating whether an item is packed in the hin 

We use binary variables /n,, for each item / e /, to indicate whether item i is 
packed in the bin. 

2. Indicating rotation 

Rotating an item means that the dimensions are interchanged: length becomes width 
and vice-versa. To indicate whether an item is rotated in a packing, we use a binary 
indicator variable r.. This variable takes value 1 if the item is rotated, and its dimensions 
are interchanged. In mathematical terms, the right upper corner of item i , inside the bin, is 
given by 

+ (V.12) 

+ (V.13) 

Another approach is to define two different items, one with the original orientation 
and the other rotated, with the sizes exchanged. If there exists an upper bound on how 
many items of each type may be used, each item counts towards this limit. 
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3. All packed items lie completely inside the bin 

When packed in the bin, all items have to be fully contained in the bin, so we use 
nonnegativity constraints on x^ and y ^, and upper bounds on the position of the right upper 
corner of the item inside the bin 

Xi+li{\-r^) + wXri)<X,i^I, (V. 14 ) 

y. + /,. {r.) + wX\-r^)<Y,i^I. (V. 15) 

4. Enforcing no overlapping 

For two items to overlap, say/and j, four conditions must be met simultaneously, 
as shown in Figure V.6; 

• The right side of / must be to the right of the left side of j. 

• The upper side of j must be above the lower side of /. 

• The right side of j must be to the right of the left side of /. 

• The upper side of i must be above the lower side of j. 



Figure V.6 This figure represents the overlap of two items, i and j. 

In this example, the right side of i is to the right of the left side of j, the upper side of j is 
above the lower side of i, the right side of j is to the right of the left side of i, and the upper 
side of i is above the lower side of j. 

When three or fewer of these conditions occur, the items do not overlap. For a 
better understanding of why this is true, consider each dimension separately. In each of the 
dimensions, the items define intervals and we can rename the coordinates of the top, or 
right, side as MaXi, and the bottom, or left, side as Mini. Then, items i and j overlap in a 
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given dimension if and only if Max^ > Mirij and MaXj > Min^. This corresponds to two of 

the previous comparisons in one of the dimensions. Also, items overlap if and only if they 
overlap in both dimensions. 

We use four binary indicator variables px.j , pXj., py^, and ppj. to represent the 
result of each of the four comparisons, mentioned above, between items i and j, with 1 
representing true and 0 false. For example, if the right side of item i is located to the right 
of the left side of item j , then px.j = 1, and if the upper side of j is above the lower side of 

item i , then py.. = 1. We can enforce no overlapping using a cardinality constraint, 

ensuring that at most three of the binary variables take value 1. Since X and Y are upper 
bounds on the horizontal (vertical) distance between items inside a container, we define the 
following set of constraints for the problem as follows: 

{x,+lX^-r^) + wXr,)\-Xj<X^ px,j, ^i e I,yj e I,j ^i, (V.16) 

lYi + ((f ) + (1 - f )] - Ty ^ J" * PYij , V/ e /, Vy e /, 7 /, (V. 17) 

P^ij + PYij + PXji + PYji ^ 5 - In, -Inj,\fi^ I, \fj e I, j>i. (V. 1 8) 

Constraints (V.16) guarantee that the right side of item i will be to the right of the 
left side of item j only if pXy is set to 1. There is a similar constraint with the roles of 

items i and j interchanged. Constraints (V.17) take care of the vertical comparisons. The 
third set of constraints is the cardinality constraint. 

5, Implementing the MIP model 

The algebraic formulation is given by 
Indices: 

i, j Items to be packed, i el, j el. 
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Data: 


X Length of bin. 

Y Width of bin. 

V. Value of item i, i el. 

/. Length of item i, iel. 

Width of item i, iel. 

Variables: 

1 if the right side of item j is to the right of the left side of item i and 

pXj 

0 otherwise. 

PYij 1 if the top of item j is above the bottom of item i and 0 otherwise. 

Ip 1 if item i is paeked in the bin and 0 otherwise. 

r^ 1 if item i is rotated and 0 otherwise. 

Horizontal position of the left side of item i in the bin. 

Yi Vertieal position of the bottom of item i in the bin. 

Formulation: 

MaxY,Y*Ip, (V.19) 

iGl 

subject to 

X, + /, (1 - ^ ) + w-r. <X,i el, (V.20) 

L + +w,{\-r.)<Y,ieI, (V.21) 

[Xi + /,. {\-r,) + w^r. ]-Xj<X* px^ ,yiel,yj el, (V.22) 

[y, + hn + w, (1 -r,)]- y. <Y*py^.,\/ie I, \fj el, (V.23) 

Phj + PYy + PXji + PYji <5-Ip-Inj,yieI,yjeI,j>i, (V.24) 

pxy e {0,1}, Vi e /,y/' e I, py.j e {0,1}, Vi e /,y/' el, 

Ip e {0,1}, Vi el ,r. e {0,1}, V/ el, 

X. > 0, V/ e /, Yi > 0, Vi e / . 
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Constraints (V.20) and (V.21) enforce the right and top limits of the bin for each 
item. Constraints (V.22) and (V.23) are used to verify the relative position of items inside 
the bin. If the items are not packed, we don't care about the values of pxij and pyij. 
Constraint (V.24) enforces non-overlap between two items only if both items are packed in 
the bin. 

We implemented this model using GAMS [GAMS 2000], and solve some instances 
from the literature using the CPLEX 6.6 solver [ILOG 2000] and OSL 2 [IBM 2000] on a 
Pentium IV 1.5 GHz personal computer, with default solution settings. These instances 
are: twelve instances used by Beasley [1985b], referred to as NGCUTl to NGCUT12, 
available from the OR-Library [Beasley 2002]; and instances 3 and 11 from 
Hadjiconstantinou and Christofides [1995], referred as HC3 and HCll. Instances 
NGCUT6 (HC5), NGCUT7 (HC2), NGCUT9 (HC6) and NGCUT12 (HC7) are common 
to both works. Table V.l lists some details for these instances, including bin sizes, number 
of distinct types of item, and number of items available. Beasley [1985b] implements his 
algorithm on a CDC 7600 computer, and Hadjiconstantinou and Christofides [1995] use a 
CYBER-855 computer. Items are presorted to in an increasing value order. 
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Instance 

X 

Y 

# Types of 

Items 

# Items 

Beasley 

Rnn Times (Sec) 

H&C 

Rnn Times (Sec) 

NGCUTl 

10 

10 

5 

10 

0.9 

- 

NGCUT2 

10 

10 

7 

17 

4.0 

- 

NGCUT3 

10 

10 

10 

21 

10.5 

- 

NGCUT4 

15 

10 

5 

7 

0.1 

- 

NGCUT5 

15 

10 

7 

14 

0.4 

- 

NGCUT6 (HC5) 

15 

10 

10 

15 

55.2 

45.2 

NGCUT7 (HC2) 

20 

20 

5 

8 

0.5 

0.0 

NGCUT8 

20 

20 

7 

13 

218.6 

- 

NGCUT9 (HC6) 

20 

20 

10 

18 

18.3 

5.2 

NGCUTIO 

30 

30 

5 

13 

0.9 

- 

NGCUTll 

30 

30 

7 

15 

79.1 

- 

NGCUT12 (HC7) 

30 

30 

10 

22 

229.0 

65.2 

HC3 

30 

30 

7 

7 

- 

532.0 

HCll 

30 

30 

15 

15 

- 

> 800.0 


Table VI Description of instances used by Beasley [1985b] and Hadjiconstantinou and 
Christofides [1995], 

The fist column contains the references to the instances. The second and third columns 
contain the length and width of the bin. The forth and fifth columns list the number of 
different types of items and the total number of items in the instance. The last two columns 
contain run times reported by the authors, with H&C indicating Hadjiconstantinou and 
Christofides [1995]. A dash (-) in a cell indicates when an instance is not considered in 
the work. The execution of instance HCll was limited to 800 seconds. 

We initially address the oriented version of the problems, to be able to eompare our 
results with the previous works. Table V.2 presents run times obtained with our MIP, on a 
Pentium IV 1.5 GHz personal computer, and the run times reported by Beasley [1985b] and 
Hadjiconstantinou and Christofides [1995]. In this implementation, no rotations are 
allowed, so the rotation indicator is removed from the model. Execution times are limited 
to 1,000 seconds. 
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Instances 

Optimal 

Solntion 

Valne 

Beasley 

Rnn Times 

(Sec) 

H&C Rnn 

Times (Sec) 

MIP Solntion 

MIP Rnn 

Times 

CPLEX 6.6 

(Sec) 

NGCUTl 

164 

0.9 

- 

164 

4.0 

NGCUT2 

230 

4.0 

- 

230 

> 1,000 

NGCUT3 

247 

10.5 

- 

246 

> 1,000 

NGCUT4 

268 

0.1 

- 

268 

0.3 

NGCUT5 

358 

0.4 

- 

358 

521.3 

NGCUT6 (HC5) 

289 

55.2 

45.2 

289 

189.5 

NGCUT7 (HC2) 

430 

0.5 

0.0 

430 

0.2 

NGCUT8 

834 

218.6 

- 

834 

> 1,000 

NGCUT9 (HC6) 

924 

18.3 

5.2 

900 

> 1,000 

NGCUTIO 

1,452 

0.9 

- 

1,452 

16.2 

NGCUTll 

1,688 

79.1 

- 

1,688 

> 1,000 

NGCUT12 (HC7) 

1,865 

229.0 

65.2 

1,707 

> 1,000 

HC3 

1,178 

- 

532.0 

1,178 

0.2 

HCll 

1,270 

- 

> 800.0 

1,270 

> 1,000 


Table V.2 Run times obtained when solving selected instances from the literature, 
described in Table V.l. 

The execution of CPLEX 6.6 is limited to 1,000 seconds. In instances NGCUT2, NGCUT8, 
NGCUTll, and HCll, although the solver attains the optimal solution value, it is not able 
to verify it. In most instances, an optimal solution is obtained in a few seconds. 

CPLEX is able to solve most of these instanees from the literature. Only two 
instances are not solved to optimality within 1,000 seconds, but in another five instances 
the solver is not able to verify the optimality of the solution. On the other hand, it is able to 
almost instantly solve instance HC3, which required Hadjiconstantinou and Christofides 
[1995] more than 500 seconds. A close review of the model reveals the existence of 
several sources of symmetry, e.g., items of the same type being packed. 

Because of the promising results in this first application of the MIP on oriented 
versions of the instances, we decide to analyze ways of improving the model with the 
objectives of reducing symmetry and obtaining a tighter LP relaxation of the MIP. 
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6. Improved MIP model 


In order to obtain an improved model, we introduee some simple modifieations, 
ineluding additional constraints and inclusion of new data. 

Maximum Area: 

The total area covered by all packed items cannot be larger than the area of the bin. 
This constraint makes the LP relaxation tighter: 


iel 


(V.25) 


Type of item: 

The initial formulation does not use the information regarding the type of item 
being packed - two copies of the same item are considered different items. Therefore, if 
item i is packed and item j not, but both are of the same type, then we can exchange them 
and obtain a similar packing pattern. We can reduce this symmetry by including an 
additional type of data, t. , type of item i , and use the order in which the items are included 
in a list to define the sequence to pack items of the same type. The resulting constraint: 

Itij tj = J>i. (V.26) 

Sorting items in the bin: 

If multiple items of a given type are packed in the bin, then we can exchange the 
position of these items and obtain basically the same pattern but with a different order in 
which the items are packed. To eliminate this symmetry for two items of the same type 
packed, we force the item with higher order to be packed at a position with larger sum of 
coordinates: 

Xj + yj > X,. + y,, Vi e /, Vy e /, tj = ,j>i. (V.27) 

Admissible combinations of indicator variables: 

If we consider the indicator variables used to enforce no overlap between two items, 
pxij, pyij, pxji, and pyp, the admissible combinations, out of the 16 (2"^) possible, are shown in 
Figure V.7. Item i is fixed at the center while item j takes different positions relative to 
item i. Each set of four digits indicates the values of the binary variables obtained when 
performing the comparisons mentioned above. For example, the combination 0011, on the 
upper right comer of the picture, indicates: 


no 



• The right side of i is not to the right of the left side of j or pXy - 0 . 

• The top of i is not above the bottom of j or py^j = 0. 

• The right side of j is to the right of the left side of i or pXj- = 1. 

• The top of j is above the bottom of i or ppj. = 1. 



Figure V. 7 Allowed assignments for the indicator variables. 

Although there are 16 possible assignments to four binary variables, there are only nine 
combinations that could result from the comparison of the relative positions of two 
rectangles, and eight of those are feasible. The combination 1111 is not feasible and 
indicates overlap. 

From this figure, it is possible to observe that at least two of the binary variables, 
one for eaeh dimension, are always equal to 1 in a feasible solution. Patterns 0101 and 
1010 are inadmissible, beeause these eorrespond to one of the dimensions with no binary 
variables taking value one (not physieally possible). We ean, therefore, add another set of 
eonstraints, foreing the sum of the related indieator variables in eaeh dimension to be at 
least one: 

pxy + pxji > 1, Vi e /, Vy e /, 7 > /, (V.28) 

PTij + PTji >l^i^l ,Vy elj>i. (V.29) 

Constraints on “large” items: 

If two items have the length (width) larger than half of the length (width) of the bin, 
and both are plaeed in the bin, then they have to be plaeed side by side in the width (length) 
of the bin. In this ease, the sum of all items plaeed in the bin, with length (width) larger 
than Xjl {Yj!) , has to be less than the width (length) of the bin.: 


Ill 




(V.30) 


^ w,*In.<Y, 

>^/2 

Z l,>ln,<x. 

;g/,vi',->7/2 

Packing the most valued item in the first quadrant: 

Given a packing pattern, up to three other patterns might be generated just by 
reflection and rotation. If several near optimal patterns are present in the instance, the 
solver requires more time to investigate these patterns. To reduce this symmetry, we select 
the item with largest value and require it, if packed in the bin, to be placed in the first 
quadrant: 

X,. < X/2 , V. = max{vJ k e /} , (V.32) 

T, ^ , V, = max{v, | k e /} . (V.33) 

We apply this improved model, to the same instances, and the results are listed in 
Table V.3. 
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Instances 

Beasley 

Rnn Times 

(Sec) 

H&C Rnn 

Times (Sec) 

First MIP 

Rnn Times 

CPLEX 6.6 

(Sec) 

Improved 

MIP 

Rnn Times 

(Sec) 

NGCUTl 

0.9 

- 

4.0 

0.3 

NGCUT2 

4.0 

- 

> 1,000 

81.8 

NGCUT3 

10.5 

- 

> 1,000 

6.2 

NGCUT4 

0.1 

- 

0.3 

0.2 

NGCUT5 

0.4 

- 

521.3 

0.3 

NGCUT6 (HC5) 

55.2 

45.2 

189.5 

7.81 

NGCUT7 (HC2) 

0.5 

0.0 

0.2 

0.2 

NGCUT8 

218.6 

- 

> 1,000 

> 1,000 

NGCUT9 (HC6) 

18.3 

5.2 

> 1,000 

21.1 

NGCUTIO 

0.9 

- 

16.2 

0.3 

NGCUTl 1 

79.1 

- 

> 1,000 

> 1,000 

NGCUT12 (HC7) 

229.0 

65.2 

> 1,000 

72.4 

HC3 

- 

532.0 

0.2 

0.2 

HCll 

- 

> 800.0 

> 1,000 

> 1,000 


Table V.3 Comparison of the results of the first and improved models. 

Run times are substantially reduced. In two instances, NGCUT8 and HCll, although the 
optimal solution is obtained, it is not verified within 1,000 seconds. 

With the improved model produeing faster solutions to oriented problems, we adjust 
the model to solve orthogonal problems. The rotation indieator is inserted in the model, 
and the “large” item eonstraint is removed, beeause of the possibility of rotation. The 
following constraint concludes the changes in the model: 

Only rotate an item if loaded: 

We only allow the rotation indicator to be set to 1 if the item is loaded, resulting in 
the constraint: 

</n,.,V/e/. (V.34) 

Table V.4 presents the results obtained with the orthogonal MIP model, also with a 
time window of 1,000 seconds. 
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Instances 

# Items 

Oriented 

2D-KP 

Optimal 

Valne 

Orthogonal 

MIP Valne 

Improved 

MIP 

Rnn Times 

(Sec) 

NGCUTl 

10 

164 

193 

0.6 

NGCUT2 

17 

230 

250 

12.5 

NGCUT3 

21 

247 

259 

124.2 

NGCUT4 

7 

268 

268 

0.3 

NGCUT5 

14 

358 

370 

2.1 

NGCUT6 (HC5) 

15 

289 

296 

> 1,000 

NGCUT7 (HC2) 

8 

430 

430 

0.2 

NGCUT8 

13 

834 

872 

> 1,000 

NGCUT9 (HC6) 

18 

924 

874 

> 1,000 

NGCUTIO 

13 

1,452 

1,452 

1.8 

NGCUTl 1 

15 

1,688 

1,780 

> 1,000 

NGCUT12 (HC7) 

22 

1,865 

1,794 

> 1,000 

HC3 

7 

1,178 

1,272 

0.7 

HCll 

15 

1,270 

1,431 

6.95 


Table V.4 Packing values for orthogonal versions of instances from the literature. 

The first three columns are from Table V.l. The fourth column presents the values 
obtained with the MIP, and the fifth column the time required by the solver. For instances 
solved within 1,000 seconds, the value obtained is optimal. For the five instances not 
solved within the assigned time window, values are not guaranteed to be optimal, and in 
instances NGCUT9 (HC6) and NGCUT12 (HC7), values are even worse than the results 
obtained with the oriented version. 

The solver is able to solve to optimality 9 out of 14 instanees. In 13 instanees, the 
value returned by the orthogonal MIP is larger than the value obtained with the oriented 
version. Table V.5 presents details of the solutions for the four instanees without a verified 
optimal solution. 
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Instances 

Orthogonal 

MIP Valne 

Integrality Gap 

(%) 

Time to Final 

Valne (Sec) 

NGCUT6 

296 

5.76 

14.3 

NGCUT8 

872 

7.57 

625.5 

NGCUT9 (HC6) 

874 

10.0 

422.3 

NGCUTll 

1,780 

3.4 

20.0 

NGCUT12 (HC7) 

1,794 

8.7 

182.0 


Table V.5 Details of the solutions at the end of the time window, for instances not solved 
within 1,000 seconds. 

The first two columns are from Table V.4. The third column presents the value of the 
integrality gap in the last iteration of the MIP solver, representing the difference, in 
percentage, between the best integer solution and the best-relaxed solution. The fourth 
column represents, in seconds, the time required by the solver to identify the solution. 

As shown in Table V.5, the largest integrality gap observed is 10.0%, eorresponding 
to an instanee where the returned value is smaller than the value obtained with the oriented 
version. 

Although it is not able to obtain an optimal solution within the time window 
assigned, the orthogonal MIP ean solve 2D-KP using a eommereial off-the-shelf (COTS) 
solver without the need of a speeial tree seareh. 

7. Analyzing the MIP Model 

In this seetion we discuss some of the characteristics of the MIP, in comparison 
with the integer linear programs from the previous section. 

For a given assignment to variables Ip, px^j, py^, and r;., we observe that the 

values on constraints (V.26) are fixed. Constraints (V.22) and (V.23) are reduced to regular 
upper bounds on variables x, andy,. Constraints (V.19) and (V.20) present a +1 and a -1 in 
each row, with independent equations for each dimension. The problem reduces to two 
independent longest path problems, in an acyclic network, and the position of the items 
within the bin can be computed efficiently using a network-based algorithm. Items are 
positioned in the bin according to normal packing patterns. In the work of Beasley [1985b] 
and Hadjiconstantinou and Christofides [1995], the computation of cut positions 
corresponding to normal packing patterns is performed in a pre-process phase. In the 
previous work, normal packing is a pre-requisite, while here it is a result. 
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As mentioned earlier in this section, in the models proposed by Beasley [1985b] and 
Hadjiconstantinou and Christofides [1995], the number of binary variables required 
increases with |/|*|z|*| 1F| . In the present formulation, the number of binary variables 

increases with |/|^. 

Another characteristic is that fixing the relative positions of a subset of the items 
may cause a significant reduction on the number of feasible combinations left for the 
indicator variables of other items. As an example, if item j is fixed to be to the left of, and 
above, item i (1001), and item k is fixed to be to the right of, and below, item i (0110), then 
item k is also forced to be to the right of, and below, item j (0110). 

In a problem with three items, say i, j, k, we use 12 binary variables, just for 
controlling the relative position among items. If all assignments to these variables are 
feasible, we have 2 = 4,096 possible assignments. Since there are only eight feasible 

results when comparing each pair of items, we would have, at most, 8 =512 options. But 
when the relative positions between items i and j, and between items j and k, are given, the 
range of possible results, when comparing item i and k, is reduced, as shown in Table V.6. 
The rows correspond to i-j comparisons, the columns to j-k comparisons, and the entries in 
the table to possible assignments to indicator variables relative to i-k comparisons. “ALL” 
means that all eight assignments are feasible. There are only 240 feasible assignments for 
the 12 binary variables. When a larger number of items are packed in the bin, the reduction 
can be substantial. 

Finally, this number of possible assignments can be reduced even further, if we 
consider only normal packing patterns. In this case, most of the assignments in Table V.6 
will be excluded, because they do not correspond to normal patterns - at most 36 normal 
patterns exist with three items: 

• There are three choices for the item placed in the corner of the bin. 

• There are two choices for the next item to pack, and two options of where to 
place it. 

• There are at most three positions to place the last item. 
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Comparisons between items j and k 



toil 

0011 

out 

0110 

1110 

1100 

not 

loot 






1011 


1011 





1011 

1011 

0011 

1011 

0011 


1100 

1011 

1011 

1001 


toil 

1001 

0011 

0111 

ALL 

1001 

1101 



0011 

0111 

0110 


1101 

1001 






1110 


1110 









0011 


0011 






0011 

0111 

0011 

1110 


1101 

0011 


0011 


0011 

0110 

0110 

ALL 

1001 

1001 





0111 

0111 


1011 

1011 







1011 


0011 









0111 


0111 





0111 

0111 

0110 

0111 

1100 


1001 


out 



0110 

1110 

1101 

ALL 

1101 





0011 

0110 

1110 


1011 

e 







0110 


0011 

5/5 








0110 


s 






0110 

1110 

0110 

1101 



0110 




0110 

1100 

1100 

ALL 

S 






1110 

1110 


h 








0111 











1110 

5/5 

fl 






1110 

1110 

1100 

1110 

1001 

o 

1110 





1100 

1101 

1011 







0110 

1100 

1101 

s 









1100 

o 










u 

1100 






1100 

1100 

1100 

1101 

1001 









1101 









1101 

1101 


not 







1100 

1001 









1001 


loot 








1001 


Table V.6 Possible results of the comparisons between items i and j, and j and k. 

Row labels are the comparisons between items i and j. Column labels are the comparisons 
between items j and k. Table entries are the permissable comparisons between i and k. As 
an example, if j is above i (1011) and k is below j (1110), then k can be at any position 
relative to i (ALL). 

In Chapter VI, we present an algorithm for orthogonal 2D-KP able to identify 
optimal solutions more effieiently than the MIP model. We also extend this algorithm to 
solve 3D-KP instanees. 
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VI. NEW ALGORITHMS FOR MD-KP 


This Chapter proposes a new exaet algorithm for 2D-KP, based on the HVZ 
algorithm introdueed in Chapter III, and eompares the eomputational performanee of this 
algorithm with some published results for 2D-KP. Then we eonvert this algorithm, by 
limiting the number of iterations, into a heuristie, and eompare the performanee with the 
exaet algorithm and other published results. We also extend the algorithm to solve 3D-KP, 
and finally introduee a new heuristie for paeking a large number of items, but with only a 
few different types, in a two-dimensional bin. 

A. A NEW ALGORITHM FOR 2D-KP 

In Chapter I we observe there are four different types of deeisions when solving 
instanees of MD-BPP; partition, order, orientation, and relative position. In the ease of 
MD-KP, we also eneounter the same basie deeisions. The only differenee oeeurs in the 
partition seetion, beeause to solve a MD-BPP we need to determine how many eopies of an 
item to load in whieh bin, while in MD-KP there is only one bin and we want to maximize 
the value of the items paeked. 

The objeetive funetion value obtained in an instanee of MD-KP depends only on the 
partition deeision - if it is feasible to paek all seleeted items, then the order, orientation, or 
relative position among them does not ehange the value obtained in the paeking. Therefore, 
we ean divide the solution of MD-KP in two stages: seleeting whieh items to paek, the 
packing list, and testing whether paeking the items in the paeking list is feasible. 

The HVZ algorithm, proposed in Chapter IV, is developed to verify the feasibility 
of paeking a eertain number of boxes of the same type in a pallet. In that eontext, two 
eharaeters are neeessary to represent boxes at different orientations, and a third eharacter to 
represent wasted area. But if there are two or more different types of items to paek, we ean 
inerease the number of eharaeters used in the eoding. If items with types A, B, and C have 

to be paeked in a bin, we ean denote A,B, and C as rotated items, with the length 
exehanged with the width. With Z representing wasted area, we ean represent any paeking 
pattern produced with these items, and apply the same basic algorithm to verily the 
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feasibility of a packing list. As an example, if we want to pack the items listed in Table 
VI.1, selected from instance NGCUT6 [Beasley 1985b], in the 15x10 bin, we obtain the 
string DBECFAGH , representing the packing pattern in Figure VI. 1. In this example, the 
packing pattern yields no wasted area. 


TYPE 

A 

B 

C 

D 

E 

F 

G 

ff 

LENGTH 

10 

2 

11 

3 

6 

4 

2 

4 

WIDTH 

3 

9 

2 

8 

4 

5 

4 

1 

VALUE 

74 

50 

48 

46 

32 

32 

11 

7 


Table VI.l Description of items to be packed in a 15x10 bin, based on instance NGCUT6 
[Beasley 1985b]. 

The value of this packing list is 300, and is better than the solution obtained in Chapter V, 
with the orthogonal MIP limited to 1,000 seconds. 

This verification procedure is used within a first stage tree search algorithm to solve 
2D-KP. We call this the Two-Dimensional Diagonal Fill Algorithm (2D-DFA). 



Figure VI.l Packing pattern obtained when packing items listed in Table VI.l in the 
15 ^10 bin. 

1. Implementing the 2D Diagonal Fill Algorithm 

The 2D-DFA is a branch-and-bound procedure. It divides the list / of items to pack 
into three groups: items examined but not present in the packing list, items included in the 
packing list, and items yet to be examined. At each node of the search tree, the algorithm 
selects an item to be included in the packing list. If there exists a feasible pattern with this 
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packing list, then the proeedure branehes and an additional item is seleeted to be ineluded 
in the list. If it is not feasible to pack the list, then the algorithm backtracks, and the item 
under eonsideration is marked as not being used, and the next item is seleeted. 

In order to help reduee the depth of the searehtree, the list / is pre-sorted in 
decreasing values v. and, at eaeh node of the seareh tree, if the sum of the values of all 
items yet to be examined plus the total value of the present packing list is less than or equal 
to the best known solution, the algorithm also baektraeks. As in PLP ease, if less than half 
of the items in the paeking list are paeked in the bin, and the paeking pattern already 
presents more than half of the total wasted area, then the algorithm also baektraeks. 

2. Computational Results 

We compare run times and results obtained when applying the 2D-DFA, on an 
Athlon 1 GHz personal eomputer, with the algorithms proposed by Beasley [1985b] and 
Hadjieonstantinou and Christofides [1995], as described in Chapter V. Table VI.2 presents 
the results for the three algorithms, initially with fixed orientation, beeause the algorithms 
proposed in prior work only handle instanees with this restrietion. 

Table VI.2 also eontains the results obtained when applying the 2D-DFA to the 
orthogonal versions of the same instanees from the literature. Using the results of the 
orthogonal model as reference, column “Variation” presents the relative decrease observed 
in the value of the optimal solution when adopting the fixed orientation restrietion. We ean 
observe from the table that a reduction on the order of 15.0% is obtained with instance 
NGCUTl, with an average reduetion in the order of 4.9%. The fixed orientation restriction 
changes the optimal objeetive funetion value in 11 out of 14 instances. By allowing items 
to rotate, the solution space is inereased substantially, even when no better solutions are 
produeed, resulting in a eonsiderable inerease in run time. 
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Instance 

Fixed Orientation 

90“ Rotation Allowed 

Optimnm 

Valne 

Beasley 

(Sec) 

H&C 

(Sec) 

2D-DFA 

(Sec) 

Optimnm 

Valne 

Variation 

(%) 

2D-DFA 

(Sec) 

NGCUTl 

164 

0.9 

- 

0.0 

193 

15.0 

0.0 

NGCUT2 

230 

4.0 

- 

0.1 

250 

8.0 

0.1 

NGCUT3 

247 

10.5 

- 

0.3 

259 

4.6 

0.6 

NGCUT4 

268 

0.1 

- 

0.0 

268 

0.0 

0.0 

NGCUT5 

358 

0.4 

- 

0.0 

370 

3.2 

0.0 

NGCUT6 (HC5) 

289 

55.2 

45.2 

0.3 

300 

3.7 

1.7 

NGCUT7 (HC2) 

430 

0.5 

0.0 

0.0 

430 

0.0 

0.0 

NGCUT8 

834 

218.6 

- 

1.4 

886 

5.9 

2.6 

NGCUT9 (HC6) 

924 

18.3 

5.2 

0.2 

930 

0.6 

10.3 

NGCUTIO 

1,452 

0.9 

- 

0.0 

1,452 

0.0 

0.3 

NGCUTll 

1,688 

79.1 

- 

1.7 

1,786 

5.5 

84.5 

NGCUT12 (HC7) 

1,865 

229.0 

65.2 

1.5 

1,932 

3.5 

19.4 

HC3 

1,178 

- 

532.0 

0.0 

1,272 

7.4 

0.0 

HCll 

1,270 

- 

800.0 

0.0 

1,431 

11.3 

0.6 


Table VL2 Comparison of run times and results obtained with the 2D-DFA. 

This table compares results and run times obtained with the 2D-DFA with other 
algorithms, for oriented instances of 2D-KP in the literature; and presents results and run 
times of the 2D-DFA, when applied on the same instances, but with 90° rotations allowed. 
The column variation indicates the decrease, in percentage, resulting from restricting the 
instances of 2D-KP to fixed orientation. 


3. A Variation of the 2D-DFA 

The 2D-DFA can be implemented with a different first stage. In the procedure 
described above, whenever an item is added to the group of items being packed, the 
algorithm verifies that a feasible packing pattern exists using these items. But if we have a 
good solution, previously obtained with the algorithm or a heuristic, we could decide to 
only verify the feasibility of packing patterns with total value larger than the current best 
value. In this case, we would have to solve fewer feasibility problems. This variation to 
the 2D-DFA is also implemented, but the differences on computational performance are 
small. 

B, A NEW 2D-KP HEURISTIC - LIMITING THE NUMBER OF ITERATIONS 

Although the 2D-DFA is able to solve some instances of 2D-KP from the literature, 
the algorithm’s worst-case exponential run time results in extremely long run times as soon 
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as the number of different types of items, or the number of items of eaeh type available, 
gets larger. In this ease, as previously diseussed, we need to use a heuristie or to add 
additional restrietions in order to obtain a good solution in a timely fashion. 

Wang [1983] adopts the seeond alternative, adding the restrietion that the patterns 
are of guillotine type. Her algorithm minimizes the trim loss, or the amount of wasted area, 
in eonstrained 2D-KP instanees, eonstrueting larger reetangles by eonseeutively joining 
items. Daza et al [1995] use “informed methods” to improve Wang’s algorithm, and 
eompare their algorithm with two others from the literature - Wang’s [1983] and Oliveira 
and Ferreira [1990] - using eight 2D-KP instanees, P-1 to P-8, deseribed in the paper. We 
apply the 2D-DFA to the same instanees. Table VI.3 presents the results, and run times, 
from Daza et al [1995] and obtained by 2D-DFA. 


Instance 

Daza et al [1995] 

2D-DFA 

Trim Loss 

Run Time 
(Sec) 

Trim Loss 

Run Time 
(Sec) 

P-1 

0 

9.33 

0 

0.00 

P-2 

29 

48.94 

22 

115.07 

P-3 

43 

109.74 

43 

1,033.14 

P-4 

31 

38.01 

31 

1,342.05 

P-5 

0 

1.32 

0 

0.00 

P-6 

0 

8.12 

0 

0.11 

P-7 

8 

13.34 

5 

33.23 

P-8 

34 

21.53 

34 

274.53 


Table VL3 Trim loss and run times presented in Daza et al [1995] and obtained by 2D- 
DFA for eight instances of 2D-KP. 

The 2D-DFA is executed on an Athlon 1 GHz personal computer. 

Beeause the 2D-DFA eonsiders patterns other than those generated by guillotine 
euts, it is able to find solutions to two instanees with less waste than the algorithm proposed 
by Daza et al [1995], but at the expense of a considerable increase in run time. 

We investigate an alternate approach; the Limited Iteration 2D-DFA {2D-LDFA) 
limits the number of backtracks in the verification stage of the algorithm. If the feasibility 
of a packing list is unknown when this limit is reached, then it is considered as infeasible. 
We have no way to specify this limit a priori, with the number of items in the list and the 
size of the bin being important in the selection. If this limit is set too small, solutions might 
be far from optimal. If the limit is too large, long run times result. 
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Table VI.4 has the results of the application of two different levels: 1,000 and 
10,000 backtracks allowed. With the former level, the optimal solution is obtained in 5 out 
of 8 cases, taking on average 11.79 seconds to solve each instance. With the latter level, all 
instances are solved to optimality, taking on average 37.01 seconds. 


Instance 

2D-LDFA - 1,000 Backtracks 

2D-LDFA -10,000 
backtracks 

Wasted Area 

Run Time 
(Sec) 

Wasted Area 

Run Time 
(Sec) 

P-1 

0 

0.00 

0 

0.00 

P-2 

24 

31.58 

22 

99.20 

P-3 

87 

15.49 

43 

90.41 

P-4 

31 

16.15 

31 

86.01 

P-5 

0 

0.00 

0 

0.00 

P-6 

0 

3.62 

0 

0.11 

P-7 

5 

6.87 

5 

27.96 

P-8 

70 

20.60 

34 

65.69 


Table VIA Wasted areas and run times observed using the 2D-LDFA, with limits on 1,000 
and 10,000 backtracks on the verification stage of the algorithm. 

C. EXTENDING DFA TO SOLVE 3D-KP 

A natural step to follow is to extend the DFA algorithm to solve three-dimensional 
problems. In this section, we implement an algorithm for 3D-KP, verify its performance 
with some test instances, and propose a simple heuristic based on limiting the number of 
iterations in the verification stage of the algorithm. 

1. Implementing the Three-Dimensional Diagonal Fill Algorithm 

The transformation of the DFA to work with three-dimensional problems is 
straightforward. No changes are required in the first stage of the algorithm, because it only 
selects items to be loaded in the bin. This stage is essentially independent of the 
dimensionality of the problem. The second stage requires the addition of a third dimension, 
the height, in the grid representing the positions in the bin where items may be positioned 
in a normal packing pattern, and new labels to represent all six possible orientations of 
items inside the bin. We call this algorithm the Three-Dimensional Diagonal Fill 
Algorithm - 3D-DFA. 


124 




2. Computational Results 

The 3D-DFA is applied to the same instanee presented by Chen et al [1995], and it 
eomputes an optimal solution in less than a milliseeond. Then, we generate a set of 10 
random instanees, with the following eharaeteristies: 

• All bins have dimensions 30x 20x 15 . 

• Items dimensions are seleeted, independently, in the range [5, 15], with uniform 
probability. 

• Item values are integral values based on the volume of the eorresponding item 
type, and are seleeted, also with uniform probability, in the range 

Item Volume, 0.\5^ ItemVolume\. 

• The number of items available from eaeh type are seleeted in {1, 2, 3}. 

• Items are generated and ineluded in an instanee until the sum of item volumes is 
larger than a number generated between 7,200 and 10,800, or between 80% and 
120% of the volume of the bin. 

Table VI.6 eontains general information of the instanees M-1 to M-10, generated 
above. The information, presented in eolumn order, is: instanee, number of different types 
of item, number of items, total volume of items, total value of the items and an upper- 
bound on the value of the optimal paeking, obtained by modeling the problem as a ID-KP 
instanee, using the volumes and values. 
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Instance 

# Item 
Types 

# Items 

Total 
Volume of 
Items 

Total Value 
of Items 

Upper- 
Bound on 
Optimal 
Value 

M-1 

6 

15 

13,411 

1,281 

941 

M-2 

8 

17 

10,840 

1,116 

990 

M-3 

2 

6 

8,352 

1,221 

1,221 

M-4 

4 

10 

10,074 

1,060 

909 

M-5 

6 

13 

10,120 

1,022 

905 

M-6 

7 

16 

12,065 

1,107 

917 

M-7 

6 

10 

9,889 

824 

752 

M-8 

2 

5 

12,468 

847 

579 

M-9 

5 

10 

11,511 

1,158 

971 

M-10 

6 

14 

12,567 

958 

767 

Averages 

5.2 

11.6 

11,129.7 

1,169.4 

895.2 


Table VI. 5 Descriptive information of the random instances used to investigate the 
performance of the 3D-DFA. 

The information, presented in column order, is: instance, number of different types of item, 
number of items, total volume of items, total value of the items and an upper-bound on the 
value of the optimal packing, obtained using the volumes and values in as an ID-KP 
instance 

Table VI.6 presents the results, and run times, observed when applying the 3D-DFA 
on the 10 random instanees, M-1 to M-10, oriented and orthogonal versions. 


Instance 

Oriented 

Orthogonal 

Value 

Run Time 
(Sec) 

Value 

Run Time 
(Sec) 

M-1 

663 

3.25 

869 

741.28 

M-2 

843 

44.71 

939 

3,222.39 

M-3 

814 

0.00 

946 

0.00 

M-4 

666 

0.10 

892 

3.35 

M-5 

796 

0.82 

905 

69.20 

M-6 

677 

5.44 

789 

1,941.40 

M-7 

616 

0.00 

720 

6.21 

M-8 

386 

0.00 

386 

0.00 

M-9 

756 

0.00 

883 

5.05 

M-10 

590 

0.27 

712 

77.28 


Table VL6 Optimal values and run times, in seconds, obtained with the 3D-DFA, oriented 
and orthogonal versions, on 10 random instances. 

The optimal values obtained in the oriented version are, on average, 14.5% smaller 

than those generated with the orthogonal version. In one ease, the fixed orientation 
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restriction accounts for a 25.3% decrease in optimal solution value. But, as expected, larger 
problems require much longer periods of time before an optimal solution is obtained. As in 
the two-dimensional version, the use of a heuristic may be the only approach to generate 
“good” solutions in a timely fashion. 


D, THE LIMITED ITERATION 3D-KP HEURISTIC 

As in the two-dimensional case, the 3D-DFA can be converted into a heuristic by 
limiting the number of iterations on the verification stage of the algorithm. Table VI.8 
presents the comparison of results obtained with the orthogonal 3D-LDFA with the upper 


bound based on ID-KP, and the results of the oriented and the orthogonal 3D-DFA. 


Instance 

Upper Bound 

3D-DFA 

3D-LDFA 

Fixed 

Orientation 

90" Rotations 
Allowed 

Value 

Run Time 
(Sec) 

M-1 

941 

663 

869 

869 

40.43 

M-2 

990 

843 

939 

897 

54.43 

M-3 

1221 

814 

946 

946 

0.00 

M-4 

909 

666 

892 

822 

1.70 

M-5 

905 

796 

905 

866 

13.13 

M-6 

917 

677 

789 

759 

109.96 

M-7 

752 

616 

720 

665 

1.10 

M-8 

579 

386 

386 

386 

0.00 

M-9 

971 

756 

883 

883 

1.54 

M-10 

767 

590 

712 

704 

39.27 


Table VI. 7 Packing values, and run times, obtained with the 3D-LDFA. 

Execution is limited to 200 backtracks before restarting the search tree, at the first level of 
the tree, on an Athlon 1 GHz personal computer. 


E. A FIVE-BLOCK HEURISTIC FOR 2D-KP 

In Section C we present a heuristic for 2D-KP based on limiting the number of 
iterations of the verification stage of the DFA. There is no constraint on the number of 
items of the same type in the packing pattern, so if this number is large, even the proposed 
heuristic can require long run times. 

There is a variation of the 2D-KP for which the use of a PLP heuristic, combined 
with partitioning the bin in blocks, may yield very good results. Scheithauer and 
Sommerweiss [1998] investigate the Rectangle Packing Problem (RPP). In an instance of 
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RPP, a relative large amount of items, from a few different item types, have to be packed in 
a bin, with the objective of maximizing the used area. Using the typology proposed by 
Dyckhoff [1990], this problem is of type 2!B!O!F . There may be constraints on the 
minimum and maximum number of items of each type in the packing pattern. 

In their work, the authors divide the bin in up to four blocks, as in the Four-Block 
heuristic for PLP, and use the G4-heuristic [Scheithauer and Terno 1996], within each 
block, to select the item type to pack in the block. Only items of the same type are packed 
in each block. The wasted area computed up to a step in the algorithm is used as a 
bounding rule. The authors report that the heuristic, the Four-Block Heuristic, yields area 
usage above 99% of the bin area in several random instances solved. One of the possible 
improvements considered by the authors, but not implemented, is the use of five blocks, 
with the addition of a central block, as in the five-block heuristic for PLP. 

Because the analysis of the G5-heuristic for PLP, in Chapter IV, shows that it 
generates solutions as good as the G4-heuristic, we investigate the Five-Block Heuristic for 
2D-KP using the G5-heuristic to define the composition of each block. 

1. Implementing the Five-Block Heuristic for 2D-KP 

The main difference between the four-block and five-block heuristics, as indicated 
by their titles, is the maximum number of blocks containing items of the same type allowed 
in the solution. The four-block heuristic generates solutions similar to Figure 11.7, while 
the five-block heuristic can produce solutions resembling Figure 11.8. 

As in the PLP case, we only consider linear combinations of the length and width of 
each item being packed when defining the dimensions of the two initial comer blocks 
(blocks I and III). Then, we apply the G5-heuristic within each block to determine the 
packing pattern. We store the best packing patterns obtained for a block with given 
dimensions so we can use it again later in the algorithm, if necessary. 

For each item k, we consider, without loss of generality, that 4 > . The 

dimensions of block i, / = 1,2,3,4,5, are given by {L^,W.) , and C. the total value of the 
items packed in block i. In the algorithm proposed by Scheithauer and Sommerweiss 
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[1998], C^ is defined by the used area within eaeh bloek. In the present algorithm, we 
eonsider the more general ease of 2D-KP. 

Let G, = {g\g < L,g = n*li^+m*Wi^,for someitemk) be the set of dimensions to 
be investigated as the length of bloeks I and III. 

Let G^-{g\g<W,g = n^l^+m*w,^, for some item k} be the set of dimensions to 
be investigated as the width of bloeks I and III. 

The pseudoeode for the five-bloek heuristic for 2D-KP is: 

For each L, e G,, L 2 <— X -f 
For each W^eG^, IL 3 <— T - IF,, compute Q 

For each eG,, L4 <— X -Z3, compute C4 
For each W^^G^, W 2 <^Y-W ^,computeCj andC 3 
If no blocks overlap, then 
Compute Lj, and 

If Cj + Cj + C 3 + C 4 + C 5 is higher than the previous best, record solution. 

2. Computational Results 

Scheithauer and Sommerweiss [1998] use sets of 100 random generated instances to 
investigate the performance of the four-block heuristic. The bin has fixed dimensions, 
1,250x800, and items are uniformly generated in the range [lOO, 300]. All instances 

initially have four different item types, and additional item types are added until ten 
different types are available in each instance. Then the algorithm is applied successively to 
each instance, with from four up to ten item types. In our analysis of the performance of 
the five-block heuristic, we use a set of instances generated using the same procedure. 
Initially, the objective is to minimize wasted area. 

Table VI .8 presents some statistics computed from the results of the application of 
the five-block heuristic to the set of 100 instances. Columns are numbered from four to ten, 
representing the number of different item types in each instance group. The “G5-heuristic” 
and “Four-block” rows present the average area usage resulting from the selection of the 
best G5-heuristic pattern, and best four-block pattern. The “Five-block” row has average 
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area usage obtained with the five-bloek, with the same instanees. The number of instances, 
out of 100, where the five-block yields a better result than the four-block is counted in the 
row “Better.” 



4 

5 

6 

7 

8 

9 

10 

Four-block (%) 

98.70 

98.94 

99.15 

99.27 

99.39 

99.46 

99.52 

G5-heuristic (%) 

95.72 

96.22 

96.56 

96.78 

97.00 

97.15 

97.32 

Five-block (%) 

98.82 

99.04 

99.23 

99.34 

99.46 

99.51 

99.57 

Better 

36 

35 

36 

42 

39 

35 

39 


Table VI. 8 Average area usage obtained with three dijferent block heuristics. 

Columns are numbered from four to ten, representing the number of different item types in 
each set of instances. Each set is composed of 100 randomly generated problems. The 
“G5-heuristic” and ‘four-block” rows contain the average area usage resulting from the 
selection of the best G5-heuristic pattern, and best four-block pattern. The “Five-block” 
row has average area usage obtained with the five-block, with the same instances. The 
number of instances, out of 100, where the five-block yields a better result than the four- 
block is counted in the row “Better. ” 

In the table, we can observe that more than 35% of the instances had a better 
solution using the five-block heuristic, although the improvement in area usage is small. 
The relative change in wasted area, when it occurs, is on the order of 20%. The authors of 
the four-block heuristic observe that up to 96 items can be packed in the instances 
considered. In this case, the items are small relative to the bin, making them easer to pack. 

The average run times for the five-block heuristic are compatible with those 
reported for the four-block heuristic, but the run times with the five-block heuristic do not 
increase with number of types of items as quickly as with the four-block (as reported by 
Scheithauer and Sommerweiss [1998], and shown in Table VI.9). The run times presented 
in the table for the five-block corresponds to the execution on a Athlon 1 GHz personal 


computer. For the four-block heuristic, times are those reported in the original work on a 
586 200 MHz personal computer. 


Heuristic 

4 

5 

6 

7 

8 

9 

10 

Four-block (Sec) 

0.20 

0.34 

0.54 

0.73 

1.02 

1.37 

1.78 

Five-Block (Sec) 

0.10 

0.14 

0.17 

0.21 

0.24 

0.28 

0.34 


Table VL9 Average run times, in seconds, with the five-block heuristic, in the present 
research, and the four-block heuristic, as reported by Scheithauer and Sommerweiss 
[1998]. 


We generate a second set with 100 random instances, this time with items with 
dimensions selected in the range [200, 400], and the same bin. Instances with this range of 
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items contain a minimum of 6 and a maximum of 24 items. Table VI.10, with the same 
layout as Table VI.9, presents the results for this new set. 



4 

5 

6 

7 

8 

9 

10 

Four-block (%) 

96.41 

97.08 

97.47 

97.80 

98.10 

98.39 

98.52 

G5-heuristic 

(%) 

92.46 

93.24 

93.65 

93.91 

94.28 

94.61 

94.80 

Five-block (%) 

96.51 

97.19 

97.52 

97.90 

98.21 

98.49 

98.60 

Better 

11 

14 

12 

18 

25 

22 

23 


Table VI. 10 Results obtained with 100 instances, item dimensions selected in the range 
[200,400], with the same layout as Table VI.8. 


In this range, although the number of cases in which the five-block heuristic 
generates a better solution is smaller than in Table VI.9, the relative change in the wasted 
area is about the same. 

3. A More General Case of 2D-KP 

Besides the number of blocks, and the underlying PLP heuristic, another difference 
between the four-block heuristic [Scheithauer and Sommerweiss 1998] and the proposed 
five-block heuristic is that the former is implemented to solve the variation of 2D-KP, 
based on maximizing the area usage of packed items, or minimization of trim loss. The 
four-block heuristic proponents do not directly address the more general case, where the 
value V. of item type i is different than, and not even related to, the area of the item. 

The five-block heuristic is developed with this more general instance in view, and it 
can select the best block composition based on the total value of items packed in the block, 
not the wasted area in it. But in this case, the bounding procedure based directly on wasted 
area does not work, because it is possible to generate a block with more wasted area, but 
with larger value. 

To overcome this difficulty, we adopt a different bounding procedure: 

• Compute, a priori, the Maximum Value Density (MVD) - the largest ratio 
between the value of an item and its area: MVD = Max(vJ{l. * w.)); 

• After defining the dimensions of a block, and solving the associated PLP 
instance, add all wasted area observed up to that point, including any inter-block 
wasted areas; 
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• Compute the useable area left in the bin, subtraeting all wasted area from the bin 
area; 

• The sum of the values of the bloeks already defined, plus the produet of the 
MVD and useable area is an upper bound on total number of items; and 

• If this sum is smaller than the present best solution value, then move to another 
branch of the search tree. 

This bounding procedure is not as efficient as the procedure used when the problem 
involves only the minimization of trim loss, where the value density is just equal to one. 

To verify the performance with this new heuristic, we generate another set, with the 
same characteristics as the set applied in the minimization of trim loss case, but with items 
with value densities uniformly drawn in the range [0.5,1.5]. Table VI. 11 contains the 

average ratio of packing value per bin area obtained with the best G5-heuristic solution and 
with the five-block heuristic, for each group of 100 instances. The table also includes the 
number of instances, out of 100, where the five-block heuristic yields a better solution then 
the G5-heuristic. The last row has the average run times for the five-block, on an Athlon 1 


GHz personal computer. 



4 

5 

6 

7 

8 

9 

10 

G5-heuristic (%) 

1.17 

1.22 

1.24 

1.26 

1.27 

1.28 

1.29 

Five-block (%) 

1.20 

1.25 

1.28 

1.30 

1.32 

1.33 

1.34 

Better 

64 

79 

82 

85 

86 

88 

89 

Run Times 

0.39 

0.62 

0.84 

1.18 

1.66 

2.10 

2.71 


Table VI.ll Average ratio of packing value by bin area obtained with the G5- and five- 
block heuristics. 

Columns are numbered from four to ten, representing the number of different item types in 
each set of instances. Each set is composed of 100 randomly-generated problems. The 
“G5-heuristic” and “Five-block” rows have average ratio of packing value by bin area 
obtained with the corresponding heuristic. The number of instances, out of 100, where the 
five-block yields a better result than the four-block is counted in the row “Better. ” 
Average run times, in seconds, observed with the five-block heuristic are listed in the last 
row. 
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VII. THE MULTIDIMENSIONAL BIN PACKING PROBLEM 


Martello et al [2000] present an exaet algorithm for 3D-BPP, and state “to our 
knowledge, no algorithms for the exaet solution of 3D-BPP have been published.” This 
work eomes after more than three deeades dedieated by several researehers to this problem, 
sinee Gilmore and Gomory [1965] first deseribed their formulation of the Three- 
Dimensional Cutting Problem. But Martello et al had to give up something in order to 
eontrol the exponential growth of the enumeration problem - they only eonsider instanees 
with fixed orientation. 

In the previous ehapters, we have developed the neeessary tools to determine if it is 
feasible to paek a given list (paeking list) of items in a single bin, and to seleet the paeking 
list with maximum value to paek in a single bin in both two- and three-dimensions. To 
eonelude our studies in this dissertation, we employ these tools to develop exaet and 
heuristie algorithms for 2D-BPP and 3D-BPP, whieh handle orthogonal problems (only 90° 
rotations are allowed), and show that these algorithms ean be used to solve instanees of 
MD-BPP from the literature. 

A, SOLUTION APPROACHES FOR MD-BPP IN THE LITERATURE 

The first solution approaeh for 2D-BPP in the literature is proposed by Gilmore and 
Gomory [1965]. It involves the eombined use of Two-Stage Guillotine Cutting Patterns 
(shown in Chapter IV), linear programming with eolurnn generation teehniques (previously 
applied in the one-dimensional version [Gilmore and Gomory 1961]), and the solution of 
two knapsaek problems, one for eaeh dimension, at eaeh eolurnn generation step. As in the 
one-dimensional ease, fraetional solutions are rounded to integer ones. The authors also 
present and diseuss the extension of their solution teehnique to 3D-BPP. 

Chen et al [1995] propose a different approaeh, based on a MIP for 3D-BPP. Only 
a small instanee of 3D-KP is solved in the paper. As diseussed in Chapter V, adopting a 
MIP model and a general-purpose solver saerifiees information regarding the geometrie 
eonstruetion of the eonstraints. 
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Martello et al [2000] analyze new bounds for 3D-BPP, and present both exact and 
approximate algorithms. Their exact algorithm is based on a two-level decomposition, also 
used for 2D-BPP [Martello and Vigo 1998], and can be traced back to the original ideas of 
Gilmore and Gomory [1961]. Both works consider only fixed-orientation instances. 

Wang [1983] proposes an approximation algorithm for The General Cutting Stock 
Problem, a version of orthogonal 2D-BPP, allowing bins of different sizes but considering 
only guillotine cuts. Chung et al [1982] uses a hybrid procedure, based on 2D-PP, in an 
approximation algorithm for 2D-BPP, also with fixed orientation. 

Heuristics for solving 3D-BPP are proposed by Ivancic et al (as reported by 
Bischoff and Ratcliff [1995]), Bischoff and Ratcliff [1995], Temo et al [2000], Lodi et al 
[2002b], among others. 

B. OBTAINING EXACT SOLUTIONS TO MD-BPP 

Our algorithm to solve MD-BPP is a Branch-and-Price (B&P) algorithm (e.g., 
Johnson et al [2000]), based on the original cutting stock formulation of Gilmore and 
Gomory [1961], but solved to optimality. Our branch-and-bound algorithm uses a linear 
relaxation of Gilmore and Gomory’s integer linear program with dynamic column 
generation, employing our proposed two-stage algorithms for MD-KP for column 
generation. 

As described by Gilmore and Gomory [1961], given a list / of item types to cut, 
with demand d., i e I, if set of all feasible cutting patterns, J, is known beforehand, our 

problem becomes selecting how many times each cutting pattern is used to produce the 
optimal solution, attending the demand of all items, and using the least amount of stock. 
Let a^j, iel, jeJ represent the number of items of type i in the pattern j. If two 

patterns present the same numbers of each item type, even in a different layout, they are 
considered to be the same pattern. 
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The formulation is: 


Indices: 

i Item types, / e /. 

j Cutting patterns, j . 

Data: 

d. Demand of item type i. 

a-j Number of items of type i in pattern j . 

Variables: 

Xj Number of times pattern j is used in the cutting process. 

Formulation: 

Min^Xj , 

j&j 

subject to 

Y,ayXj=d„iel, VII. 1 

Xj e . 

The main deficiency with this approach is that the feasible patterns are not known 
beforehand, because identifying all potential patterns requires too much computational 
effort. To overcome this difficulty, Gilmore and Gomory [1961] propose the application of 
the simplex algorithm, and the generation of a pattern only when it prices favorably. In the 
one-dimensional case, generating a pattern requires solving a ID-KP [Gilmore and Gomory 
1961]. In the two-dimensional case, when considering only two-stage cutting patterns, two 
instances of ID-KP are solved to generate a pattern [Gilmore and Gomory 1965]. In the 
general case, addressed in this dissertation, a 2D-KP or 3D-KP is solved to generate a 
pattern. 
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The algorithm starts by generating the columns necessary to establish a simplex 
basis and computing the simplex multipliers associated with it. The basis is obtained by 
solving an instance of MD-KP considering only one type of item per column generated, and 
the multipliers are used to identify a favorable new column, again using the algorithm for 
MD-KP. A new basis and corresponding simplex multipliers are obtained, and the search 
for a new column is repeated. When no additional favorable columns can be generated, the 
algorithm proceeds to the branch-and-bound stage. In this stage, as new integrality 
restrictions are generated, each new extended linear program instance is solved, again, with 
column generation. 

To investigate this new algorithm, we implement it in a non-automated fashion. 
Once the first set of columns, corresponding to the initial relaxed LP is generated, this set is 
exported to an EXCEL 2000 [Microsoft 1999] spreadsheet, where the IP solver is used to 
identify the cuts to be added to the relaxed LP, in order to generate new simplex 
multipliers. Although the procedure takes advantage of a previous basis when solving a the 
system with an added column, the whole procedure is painfully slow, and is only adopted to 
show that it can be used to solve MD-BPP. 

We initially apply the proposed algorithm on a subset of 2D-BPP instances 
investigated by Martello and Vigo [1998]. This subset contains 28 problems originally 
created as 2D-KP instances, and are solved as 2D-BPP with fixed orientation. Christofides 
and Whitlock [1977] generate three instances (CGCUT1-CGCUT3), and Beasley [1985a 
and 1985b] the other 25 instances (GCUT1-GCUT13 and NGCUT1-GCUT12). Among 
these instances, on 14 occasions the solution with the oriented algorithm does not equal the 
continuous lower bound and could benefit from the application of an orthogonal algorithm. 
In 12 of these instances, the algorithm proposed here obtains an orthogonal solution better 
than the oriented solution, with a 10.4% (17 bin) reduction in the number of bins required 
to pack all items. 

Table VII.l presents the data relating 2D-BPP instances analyzed. The first column 
identifies the instance; the next column shows the number of items to pack in the instance; 
the third column represents the continuous lower bound; the fourth lists the number of bins 
required in the oriented version of the instance, as by Martello and Vigo [1998]; the fifth 
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lists the number of bins required in the orthogonal version, as obtained in this dissertation; 
and the last column shows the relative reduction in the number of bins used in each 
instance. 


Instance 

# Item 
Types 

# Items 

Continnons 

Lower 

Bonnd 

Martello 
and Vigo 
Solntion 

Orthogonal 

Optimal 

Solntion 

Variation 

(%) 

CGCUTl 

7 

16 

2 

2 

2 

0.0 

CGCUT2 

10 

23 

2 

2 

2 

0.0 

CGCUT3 

20 

62 

16 

23 

18 

27.8 

GCUTl 

10 

10 

3 

5 

4 

25.0 

GCUT2 

20 

20 

5 

6 

5 

20.0 

GCUT3 

30 

30 

7 

8 

7 

14.3 

GCUT4 

50 

50 

12 

14 

13 

7.7 

GCUT5 

10 

10 

3 

3 

3 

0.0 

GCUT6 

20 

20 

5 

7 

6 

16.7 

GCUT7 

30 

30 

9 

11 

10 

10.0 

GCUT8 

50 

50 

12 

14* 

12 

16.7 

GCUT9 

10 

10 

3 

3 

3 

0.0 

GCUTIO 

20 

20 

6 

7 

7 

0.0 

GCUTl 1 

30 

30 

7 

9 

8 

12.5 

GCUTl 2 

50 

50 

13 

16 

15 

6.7 

GCUTl 3 

32 

32 

2 

2 

2 

0.0 

NGCUTl 

5 

10 

2 

3 

3 

0.0 

NGCUT2 

7 

17 

3 

4 

3 

33.3 

NGCUT3 

10 

21 

3 

3 

3 

0.0 

NGCUT4 

5 

7 

2 

2 

2 

0.0 

NGCUT5 

7 

14 

3 

3 

3 

0.0 

NGCUT6 

10 

15 

2 

3 

2 

50.0 

NGCUT7 

5 

8 

1 

1 

1 

0.0 

NGCUT8 

7 

13 

2 

2 

2 

0.0 

NGCUT9 

10 

18 

3 

3 

3 

0.0 

NGCUTIO 

5 

13 

2 

3 

3 

0.0 

NGCUTl 1 

7 

15 

2 

2 

2 

0.0 

NGCUTl 2 

10 

22 

3 

3 

3 

0.0 

TOTAL 

487 

636 

135 

164 

147 

11.6 


Table VII.l Results for 2D-BPP instances solved with our exact algorithm. 

The first column identifies the instance; the next two columns show the number of different 
item types and number of items to pack in the instance; the fourth column represents the 
continuous lower bound; the fifth has the number of bins required in the oriented version of 
the instance, as obtained in Martello and Vigo [1998]; the sixth has the number of bins 
required in the orthogonal version, as obtained in the present work; and the last column 
shows the relative increase in the number of bins, when comparing the optimal solution 
value of the oriented version with the optimal solution value of the orthogonal version. 
* Indicates that the result is the best available, but may not be optimal for the oriented 
version of the instance. 

Observe that the fixed orientation restriction imposed by Martello and Vigo might 
produce solutions 50% larger than necessary in a packing situation, as in instance 
NGCUT6. Even in instances requiring the use of several bins, as in CGCUT3, the 
restriction contributes an increase of 27.8% to the number of bins used. 
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Run times involved in solving these instanees to optimality range from less than a 
seeond, as in instanee NGCUT7, to several hours, as in instanee GCUT8. In this latter 
instanee, more than 200 eolumns are generated by the algorithm, 136 of those in the initial 
relaxed LP. Table VII.2 presents the number of eolumns generated in the proeedure, in the 
initial relaxed LP, and within the braneh-and-bound proeedure. 


Instance 

# Item 
Types 

# Items 

Continnons 

Lower 

Bonnd 

Orthogonal 

Optimal 

Solntion 

# Colnmns 
in the 
Initial 
Phase 

# Colnmns 
in the BB 
Phase 

CGCUTl 

7 

16 

2 

2 

23 

0 

CGCUT2 

10 

23 

2 

2 

12 

0 

CGCUT3 

20 

62 

16 

18 

59 

17 

GCUTl 

10 

10 

3 

4 

20 

0 

GCUT2 

20 

20 

5 

5 

58 

0 

GCUT3 

30 

30 

7 

7 

97 

30 

GCUT4 

50 

50 

12 

13 

121 

0 

GCUT5 

10 

10 

3 

3 

13 

0 

GCUT6 

20 

20 

5 

6 

64 

0 

GCUT7 

30 

30 

9 

10 

80 

0 

GCUT8 

50 

50 

12 

12 

136 

100 

GCUT9 

10 

10 

3 

3 

13 

0 

GCUTIO 

20 

20 

6 

7 

44 

0 

GCUTl 1 

30 

30 

7 

8 

79 

0 

GCUTl 2 

50 

50 

13 

15 

128 

3 

GCUTl 3 

32 

32 

2 

2 

34 

0 

NGCUTl 

5 

10 

2 

2 

12 

5 

NGCUT2 

7 

17 

3 

3 

18 

0 

NGCUT3 

10 

21 

3 

3 

25 

0 

NGCUT4 

5 

7 

2 

2 

6 

0 

NGCUT5 

7 

14 

3 

3 

20 

0 

NGCUT6 

10 

15 

2 

2 

29 

0 

NGCUT7 

5 

8 

1 

1 

6 

0 

NGCUT8 

7 

13 

2 

2 

8 

0 

NGCUT9 

10 

18 

3 

3 

31 

0 

NGCUTIO 

5 

13 

2 

3 

12 

0 

NGCUTl 1 

7 

15 

2 

2 

20 

0 

NGCUTl 2 

10 

22 

3 

3 

34 

0 


Table VIL2 Details of column generation in the application of the B&P algorithm to the 
same instances as in Table VII. 1. 

The first column identifies the instance, the next two columns show the number of different 
item types and number of items to pack in the instance, the fourth column represents the 
continuous lower bound, the fifth has the number of bins required in the orthogonal 
version, the sixth column shows the number of columns generated in the initial LP, and the 
last column presents the number of columns generated within the branch-and-price 
algorithm. 

We also apply the algorithm on 47 3D-BPP instanees (Iva-1 to Iva-47) initially 
investigated by Ivaneie et al (as reported by Bisehoff and Rateliff [1995]) and Bisehoff and 
Rateliff [1995]. Both works eonsider heuristies for orthogonal 3D-BPP and in these 


138 




instances all items ean be rotated on the three axes. On 12 instanees, one or both heuristies 
are able to obtain an optimal solution, as verified with the continuous lower bound, leaving 
35 instanees to be investigated. The exaet solution obtained by the new algorithm is better 
than the previously known solution on 30 instances. In total, the solution with the 
heuristies requires 79 bins more than the optimal solution. The eombined result, selecting 
the best heuristie solution to each instance, requires 61 more bins or 8.9% of the total. 

Table VII.3 presents data for the instances of 3D-BPP analyzed. The first column 
identifies the instanee, the next eolumn shows the number different types of items to paek 
in the instanee, the third eolumn represents the eontinuous lower bound, the fourth and fifth 
have the number of bins obtained with the heuristies proposed by Ivaneie et al (as reported 
by Bisehoff and Ratcliff [1995]) and Bischoff and Ratcliff, respectively, the sixth eolumn 
has the number of bins required in the optimal solution to the orthogonal version, as 
obtained in the present work, and the last eolumn shows the relative increase in the number 
of bins used in each instance, with respect to the best solution in the previous work. 

Observe that the heuristies generate solutions up to 50% larger than the optimal 
solution. 

Run times to solve these instanees to optimality range from less than a seeond, as in 
instanee Iva-1 to more than four days, as in instanee Iva-45. In this latter instance, the 
volume utilization in each of the two bins is larger than 97%, with 47 and 52 items paeked. 
In some eases, the 3D-DFA algorithm requires several hours to generate a new column, 
with only 17 columns generated, 7 in the initial relaxed LP, and 10 others within the 
branch-and-bound procedure (Table VII.4). 
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Instance 

# Item 
Types 

# Items 

Continnons 

Lower 

Bonnd 

Ivancic et 
al 

Solntion 

Bischoff / 
Ratcliff 
Solntion 

Orthogonal 

Optimal 

Solntion 

Change from 
Previons 
Best (%) 

Iva-1 

2 

70 

25 

26 

27 

25 

4.0 

Iva-2 

2 

70 

8 

11 

11 

9 

22.2 

Iva-3 

4 

180 

19 

20 

21 

19 

5.3 

Iva-4 

4 

180 

26 

27 

29 

26 

3.8 

Iva-5 

4 

180 

50 

65 

61 

51 

19.6 

Iva-6 

3 

103 

10 

10 

10 

10 

0.0 

Iva-7 

3 

103 

16 

16 

16 

16 

0.0 

Iva-8 

3 

103 

4 

5 

4 

4 

0.0 

Iva-9 

2 

110 

16 

19 

19 

19 

0.0 

Iva-10 

2 

110 

37 

55 

55 

55 

0.0 

Iva-11 

2 

110 

14 

18 

19 

16 

12.5 

Iva-12 

3 

95 

45 

55 

55 

53 

3.8 

Iva-13 

3 

95 

20 

27 

25 

25 

0.0 

Iva-14 

3 

95 

27 

28 

27 

27 

0.0 

Iva-15 

3 

95 

11 

11 

11 

11 

0.0 

Iva-16 

3 

95 

21 

34 

28 

26 

7.7 

Iva-17 

3 

95 

7 

8 

8 

7 

14.3 

Iva-18 

3 

47 

2 

3 

3 

2 

50.0 

Iva-19 

3 

47 

3 

3 

3 

3 

0.0 

Iva-20 

3 

47 

4 

5 

5 

5 

0.0 

Iva-21 

5 

95 

17 

24 

24 

20 

20.0 

Iva-22 

5 

95 

8 

10 

11 

8 

25.0 

Iva-23 

5 

95 

17 

21 

22 

18 

16.7 

Iva-24 

4 

72 

5 

6 

6 

5 

20.0 

Iva-25 

4 

72 

4 

6 

5 

5 

0.0 

Iva-26 

4 

72 

3 

3 

3 

3 

0.0 

Iva-27 

3 

95 

4 

5 

5 

4 

25.0 

Iva-28 

3 

95 

9 

10 

11 

9 

11.1 

Iva-29 

4 

118 

15 

18 

17 

16 

6.3 

Iva-30 

4 

118 

18 

24 

24 

20 

20.0 

Iva-31 

4 

118 

11 

13 

13 

12 

8.3 

Iva-32 

3 

90 

4 

5 

4 

4 

0.0 

Iva-33 

3 

90 

4 

5 

5 

4 

25.0 

Iva-34 

3 

90 

7 

9 

9 

8 

12.5 

Iva-35 

2 

84 

2 

3 

3 

2 

50.0 

Iva-36 

2 

84 

14 

18 

19 

14 

28.6 

Iva-37 

3 

102 

22 

26 

27 

23 

13.0 

Iva-38 

3 

102 

45 

50 

56 

45 

11.1 

Iva-39 

3 

102 

12 

16 

16 

15 

6.7 

Iva-40 

4 

85 

7 

9 

10 

8 

12.5 

Iva-41 

4 

85 

14 

16 

16 

15 

6.7 

Iva-42 

3 

90 

4 

4 

5 

4 

0.0 

Iva-43 

3 

90 

3 

3 

3 

3 

0.0 

Iva-44 

3 

90 

3 

4 

4 

3 

33.3 

Iva-45 

4 

99 

2 

3 

3 

2 

50.0 

Iva-46 

4 

99 

2 

2 

2 

2 

0.0 

Iva-47 

4 

99 

3 

4 

3 

3 

0.0 

TOTAL 

154 

4,556 

624 

763 

763 

684 

8.9 


Table VII. 3 Results of instances from the literature solved with the exact algorithm for 3D- 
BPP. 

Combining the best heuristic results, for each instance, a total of 745 bins are needed to 
pack all items, a number 8.9% larger than the 684 bins required in the optimal solution. 
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Instance 

# Item 
Types 

# Items 

Continnons 

Lower 

Bonnd 

Orthogonal 

Optimal 

Solntion 

# Colnmns in 
the Initial 
Phase 

# Colnmns 
in the BB 
Phase 

Iva-1 

2 

70 

25 

25 

3 

0 

Iva-2 

2 

70 

8 

9 

4 

3 

Iva-3 

4 

180 

19 

19 

6 

5 

Iva-4 

4 

180 

26 

26 

5 

2 

Iva-5 

4 

180 

50 

51 

6 

0 

Iva-6 

3 

103 

10 

10 

4 

0 

Iva-7 

3 

103 

16 

16 

3 

0 

Iva-8 

3 

103 

4 

4 

4 

0 

Iva-9 

2 

110 

16 

19 

2 

1 

Iva-10 

2 

110 

37 

55 

2 

0 

Iva-11 

2 

110 

14 

16 

2 

1 

Iva-12 

3 

95 

45 

53 

4 

0 

Iva-13 

3 

95 

20 

25 

4 

2 

Iva-14 

3 

95 

27 

27 

5 

0 

Iva-15 

3 

95 

11 

11 

6 

0 

Iva-16 

3 

95 

21 

26 

5 

0 

Iva-17 

3 

95 

7 

7 

6 

2 

Iva-18 

3 

47 

2 

2 

4 

0 

Iva-19 

3 

47 

3 

3 

4 

0 

Iva-20 

3 

47 

4 

5 

6 

8 

Iva-21 

5 

95 

17 

20 

9 

1 

Iva-22 

5 

95 

8 

8 

10 

7 

Iva-23 

5 

95 

17 

18 

8 

11 

Iva-24 

4 

72 

5 

5 

6 

10 

Iva-25 

4 

72 

4 

5 

7 

3 

Iva-26 

4 

72 

3 

3 

6 

0 

Iva-27 

3 

95 

4 

4 

3 

15 

Iva-28 

3 

95 

9 

9 

5 

6 

Iva-29 

4 

118 

15 

16 

6 

7 

Iva-30 

4 

118 

18 

20 

7 

5 

Iva-31 

4 

118 

11 

12 

5 

14 

Iva-32 

3 

90 

4 

4 

4 

3 

Iva-33 

3 

90 

4 

4 

3 

12 

Iva-34 

3 

90 

7 

8 

6 

10 

Iva-35 

2 

84 

2 

2 

3 

1 

Iva-36 

2 

84 

14 

14 

3 

0 

Iva-37 

3 

102 

22 

23 

5 

0 

Iva-38 

3 

102 

45 

45 

4 

0 

Iva-39 

3 

102 

12 

15 

5 

3 

Iva-40 

4 

85 

7 

8 

5 

9 

Iva-41 

4 

85 

14 

15 

8 

3 

Iva-42 

3 

90 

4 

4 

4 

0 

Iva-43 

3 

90 

3 

3 

4 

0 

Iva-44 

3 

90 

3 

3 

4 

1 

Iva-45 

4 

99 

2 

2 

10 

7 

Iva-46 

4 

99 

2 

2 

8 

0 

Iva-47 

4 

99 

3 

3 

6 

0 


Table VIL4 Details of column generation in the application of the B&P algorithm to the 
same instances as in Table VII.3. 

The first three columns are the same as those in Table VII3; the fourth column represents 
the continuous lower bound; the fifth has the number of bins required in the orthogonal 
version; the sixth column shows the number of columns generated in the initial LP; and the 
last column presents the number of columns generated within the branch-and-price 
algorithm. 
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Recently, Eley [2002] presents results of the application of a new heuristic on, 
supposedly, the same data set, obtaining complete packing using 716 bins. We are not able 
to compare our results with those reported by Eley because some differences can be 
observed between the instances of the data sets used in both works, with Eley reporting 
solutions to 3D-BPP using a number of bins smaller than the volume ratio bound 
(continuous lower bound) for the instances investigated here, and available at the OR- 
Eibrary [Beasley 2002], As an example. Table VII.5 lists the data for instance Iva-18. The 
continuous lower bound for this instance is 2, but Eley reports requiring only one bin to 
pack all items. 


# Item Types 

3 


Bin Dimensions: 

(30,21, 18) 

Volume of Bin: 

11,340 

Items Dimensions: 

(6, 9, 12) 

(7, 4,10) 

(3,5,11) 

# Items Available 

20 

15 

12 

Volume of Items 

12,960 

4,200 

1,980 

Volume Ratio 

1.68 



Table VIL5 Details of instance Iva-18, initially investigated by Ivancic at al (as reported 
by Bischoff and Ratcliff [1995]) and available online at the OR-Library [Beasley 2002]. 
Eley [2002] reports packing all items in this instance in only one bin, while the volume 
ratio bound (continuous lower bound) is two bins. 

C. A MORE GENERAL VERSION OF 2D-BPP 

Up to this point, the problems covered in this chapter belong to the groups 
HV111R and HV111R in Dyckhoffs typology [1990]. In these two groups, there is 
only one type of bin available. Another interesting set of instances has bins (or pieces of 
stock) of different sizes available, identified by HV! D! Rox hlVIDIR. 

Wang [1983] studies a variation of 2D-BPP where stock rectangles with different 
sizes are available, and the objective is to minimize the waste in the production a given 
number of rectangular pieces. She proposes a heuristic based on constructing larger 
rectangles from smaller ones to solve this problem, and presents the results of applying the 
algorithm on two instances. 
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Beasley [1985e] investigates an even more general version of the problem, the Two- 
Dimensional Assortment Problem {2D-AP), eonsidering the eost of the different pieees of 
stoek and smaller reetangular items. Following Wang [1983], Beasley solves the instanees 
using a heuristie, with eolumn generation as in the original work of Gilmore and Gomory 
[1965], 

Both authors only consider guillotine cut patterns in their algorithms. 


We present two new heuristics, based on replacing the 2D-DFA in the exact 
algorithm for 2D-BPP. In the former heuristic, we adopt the five-block heuristic for 2D-KP 
to generate the packing, or cutting, patterns. In the latter, the 2D-LDFA is used. 



Skalbeck 

and Schultz 

Wang 

[1983] 

Beasley 

[1985c] 

5B 

2D-LDFA 

Stock Area 

326,736 

331,344 

327,312 

322,992 

322,128 

Waste (%) 

1.90 

3.20 

2.05 

0.74 

0.47 

Run Time 

- 

12min 58sec 

8min 3sec 

12 sec 

imin 15 sec 


Table VII. 6 Results of the application of different heuristics to an instance investigated by 
Skalbeck and Schultz (as reported by Beasley [1985c]), and also solved by Wang [1983] 
and Beasley [1985c]. 

The “5B ” column lists the results of using the five-block heuristic for 2D-KP, and the “2D- 
LDFA” column lists the results of using the 2D-LDFA heuristic, limited to 1,000 
backtracks, instead of the 2D-DFA within the branch-and-price algorithm for 2D-BPP. 

The heuristic is initially applied on an instance originally investigated by Skalbeck 
and Schultz (as reported by Beasley [1985c]), and also solved by Wang [1983] and Beasley 
[1985c]. Table VII.6 presents the results published in these papers, and two results 
obtained in this dissertation: the “5B” column lists the results of using the five-block 
heuristic for 2D-KP, and the “2D-LDFA” column lists the results of using the 2D-LDFA 
heuristic, limited to 1,000 backtracks, instead of the 2D-DFA, within the branch-and-price 
algorithm for 2D-BPP. 

Beasley [1985c] investigates another set of with 12 instances of 2D-AP. The 
website of the OR-Library [Beasley 2002] reports that “the optimal solution values are not 
known at present.” We apply the five-block based heuristic on the same instances. The 
results obtained are listed in Table VII.7. 
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Instance 

Total Area of 

Items 

Total Stock 

Area 

Beasley [1985c] 

5B 

Waste 

(%) 

Rnn Time 

(sec) 

Waste 

(%) 

Rnn Time 

(sec) 

1 

288,840 

304,270 

7.69 

14.8 

5.07 

0.6 

2 

507,080 

514,928 

4.17 

41.1 

1.52 

1.7 

3 

812,020 

831,262 

5.87 

91.4 

2.31 

4.0 

4 

243,640 

249,406 

6.63 

26.5 

2.31 

0.4 

5 

560,040 

566,708 

4.95 

116.7 

1.17 

3.4 

6 

840,240 

856,391 

7.62 

313.3 

1.89 

9.1 

7 

1,691,060 

1,777,783 

16.84 

12.5 

4.88 

1.5 

8 

3,638,720 

3,792,048 

5.48 

58.9 

4.03 

11.7 

9 

5,311,440 

5,408,779 

9.07 

116.9 

1.80 

31.0 

10 

1,624,940 

1,757,942 

13.80 

24.4 

7.57 

0.8 

11 

3,538,860 

3,642,437 

6.65 

204.3 

2.84 

8.0 

12 

5,131,900 

5,265,505 

5.89 

182.3 

2.54 

18.6 


Table VII. 7 Results for 12 instances of 2D-AP investigated by Beasley [1985c]. 

Results credited to Beasley are from the original work, including run times obtained with a 
CDC 7600 computer. The columns labeled “5B” present the results of applying the five- 
block based heuristic, on an Athlon 1 GHz personal computer. 
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VIII. CONCLUSIONS AND SUGGESTIONS FOR FURTHER 

RESEARCH 

In this chapter, we review the eontributions of this dissertation and suggest further 
researeh. 

A. CONCLUSIONS AND CONTRIBUTIONS 

This dissertation eovered distinet flavors of Multidimensional Paeking Problems, 
eonsidering instanees in two and three dimensions, with different objeetive funetions. In all 
instanees eonsidered here, both items and bins have reetangular shapes. 

In Chapter I, besides introdueing the notation and the typology of MD-PP, and 
reviewing previous work, we analyze the effeet of restrieting rotation and eertain types of 
pattern restrietions on the number of bins used on 2D-BPP. It is shown that restrieting the 
orientation of items can lead to solutions using twiee as many bins as when 90“ rotations 
are allowed. The restrietions of guillotine eut patterns and U*-order non-guillotine patterns 
are also eonsidered, with asymptotie results presented. For the ease when items have to be 
paeked together, or eonneeted, up to a 33% inerease in the number of bins ean be expeeted. 

Chapters III and IV are dedieated to Pallet Loading Problems (PLP). 

In Chapter III, we define the idea of the Minimum Size Instanee (MSI) of an 
equivalenee elass of PLP, and show that every elass has one and only one MSI. This makes 
the MSI extremely helpful in distinguishing equivalenee elasses. We also develop bounds 
on the dimensions of item and pallet in the MSI of a elass, given the set of effieient 
partitions of an instanee of that elass. We also show that a bound used for almost 15 years 
[Dowsland 1987] is ineorrect. 

Applying the newly developed bounds to the MSI, we enumerate all equivalenee 
elasses with area ratio bound as large as 100. Previous work in this area eonsidered at most 
a subset of these elasses. 

Chapter IV presents a set of new bounds and algorithms developed with the 
objeetive of solving all instanees enumerated in Chapter III. 
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The first of these new bounds is the Single Homogeneous Perfeet Partition (SHPP) 
bound. This bound, together with simple heuristics, proves optimality of almost 50% of all 
classes that have no proven optimal solution after applying other simple bounds. 

The second bound is the Single Perfect Partition (SPP) bound. It can be useful 
when the MSI of a class presents only one perfect X-partition or Y-partition. 

The third bound is the Relaxed Class (RC) bound, requiring the definition of new 
relations among distinct equivalence classes of PLP - restricted and relaxed classes. Every 
feasible packing pattern in a restricted class is shown to be adoptable by a relaxed class. 

The fourth bound, the Combined Perfect Partition and Relaxed Class (CPPRC) 
bound, combines ideas of the SHPP and the RC bounds. 

Bounds based on similarity of classes and an improved LP bound are presented, but 
not completely explored. These two bounds are applied to only a few instances of PLP. 

Among the algorithms, the Hollow Block Heuristic is the simplest one proposed in 
Chapter IV. It is related to the diagonal heuristic, described in Nelissen [1993], but has a 
simpler structure. The G5-heuristic generates H*-order non-guillotine packing patterns, and 
finds optimal solutions to all instances of PLP with an area ratio (AR) bound of up to 51 
boxes, 99.999% of all instances with an AR bound of up to 100 boxes, and differs at most 
by one box in the 0.001% remaining instances. 

Three other heuristics are proposes based on non-guillotine cut patterns of higher 
order, with at most eight blocks. These heuristics solve some instances not solved with the 
G5-heuristic, nor by other heuristics from the literature. 

After the application of the proposed bounding procedures and heuristics, 6,952 
equivalence classes of PLP with an AR bound of up to 100 boxes remain without a proven 
optimal solution. An exact algorithm is developed to solve these last remaining instances. 
The HVZ algorithm is based on the idea of representing a packing pattern with a ternary 
string, with the characters H, V, and Z. This new exact algorithm, together with the 
application of the RC bound, is able to identify the optimal solution to the remaining 
instances, obtaining in only three equivalence classes a solution not generated with the 
heuristics proposed in this dissertation. 
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Chapters V and VI are dedicated to knapsack problems, in two and three 
dimensions (2D-KP and 3D-KP). 

In Chapter V we implement a mixed integer program (MIP) model of 2D-KP and 
show that it can be used, with a commercial optimization software to solve some instances 
from the literature. 

In Chapter VI, we extend the HVZ algorithm for PLP to develop the Diagonal Fill 
Algorithm (DFA) for 2D-KP and 3D-KP, and show that these new algorithms are able to 
solve orthogonal versions of instances from the literature only solved before considering 
fixed orientation or guillotine cut patterns. The two proposed algorithms, 2D-DFA and 3D- 
DFA, are the first algorithms in the literature to solve orthogonal non-guillotine instances 
of2D-KPand 3D-KP. 

Multidimensional Bin Packing Problems (MD-BPP) are addressed in Chapter VII. 
New branch-and-price algorithms for 2D-BPP and 3D-BPP, based on the 2D-DFA and 3D- 
DFA are developed. These are also the first algorithms in the literature to solve the 
orthogonal non-guillotine instances. 

For cases where a good solution soon is better than an optimal solution later, we 
substitute the exact algorithms for MD-KP in the branch-and-price procedure for MD-BPP. 
This new heuristic finds better solutions to instances of MD-BPP from the literature. 

B. SUGESTIONS FOR FURTHER RESEARCH 

In PLP, several open questions remain regarding the representation of packing 
patterns with HVZ strings. Among these questions, we can list: 

• How many distinct HVZ strings are necessary to represent an optimal packing 
pattern for all instances with up to a given number of items packed? 

• Given a PLP instance, is it possible to compute a tight bound on the length of 
the HVZ string? 

• Given an HVZ string, can we determine the classes in which it corresponds to 
an optimal packing pattern? 

• Is there an efficient method of generating the packing pattern from the HVZ 
string? 
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The MIP model, analyzed in Chapter V, is applied only with a eommereial solver, 
and we do not investigate of the performance of this model with a special-purpose branch 
and bound algorithm. One such procedure might branch on all indicator variables related to 
the comparison of two items at a time. Another procedure might fix, at each node, the 
position of an item, and insert additional constraints on other item positions. Another 
application of the model, also not explored, is within the 2D- and 3D-DFA. In this case, a 
relaxed model could compute bounds at some or all nodes of the search tree. 

Both the 2D-DFA and 3D-DFA are implemented with the primary purposes of 
showing that they can effectively solve MD-KP instances of reasonable size and 
complexity. Several performance improvements can be applied to these algorithms. For 
example, one deficiency of the algorithms is that the packing solution generated at each 
step is not reused in the next step, when a new item is included in the packing list. We 
believe that a significant improvement in processing speed can be achieved by correcting 
this deficiency. 

The algorithms for MD-BPP have been implemented only as prototypes and would 
require refining for use in the real world. 
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